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ABSTRACT 


This  thesis  begins  with  a  general  survey  of  different 
model  based  systems  for  object  recognition.  The  advantage  and 
disadvantage  of  those  systems  are  discussed.  A  system  is  then 
selected  for  study  because  of  its  effective  Affine  invariant 
matching  [Ref.  1]  characteristic.  This  system  involves  two 
separate  phases,  the  modeling  and  the  recognition.  One  is 
done  off-line  and  the  other  is  done  on-line.  A  Hashing 
technique  is  implemented  to  achieve  fast  accessing  and  voting. 
Different  test  data  sets  are  used  in  experiments  to  illustrate 
the  recognition  capabilities  of  this  system.  This 
demonstrates  the  capabilities  of  partial  match,  recognizing 
objects  under  similarity  transformation  applied  to  the  models, 
and  the  results  of  noise  perturbation.  The  testing  results 
are  discussed,  and  related  experiences  and  recommendations  are 
presented. 
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I.  INTRODUCTION 


There  has  been  considerable  growth  of  interest  in  problems 
of  object  recognition.  This  interest  has  created  an  increased 
amount  of  theoretical  methods  and  experimental 
software/hardware  for  the  design  of  object  recognition 
systems.  Applications  of  object  recognition  include  character 
recognition,  target  detection,  medical  diagnosis,  analysis  of 
biomedical  images,  remote  sensing,  identification  of  human 
faces  or  fingerprints,  archaeology,  speech  recognition, 
machine  part  recognition,  and  automatic  inspection. 

Object  recognition  is  primarily  concerned  with  the 
description  and  classification  of  measurements  taken  from  some 
physical  or  mental  process.  In  general,  object  recognition 
may  be  considered  as: 

•  Observing  the  attributes  or  characteristics  of  the 
objects , 

•  Selecting  useful  features  from  the  set  of  characteristics 
that  are  expected  for  representation  of  the  objects, 

•  Performing  the  matching  procedure  with  respect  to  a 
specific  goal  on  the  basis  of  the  representation. 

It  is  obvious  that  the  most  popular  and  largely  used 
technique  in  object  recognition  is  model-based  recognition. 
A  model-based  recognition  system  involves  comparing  the  input 
image  with  a  set  of  predefined  models  of  objects.  The  goal 
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of  such  a  system  is  to  create  a  description  of  each  of  a  known 
set  of  objects  in  advance.  Then,  these  object  models  are  used 
to  recognize  unknown  objects  in  an  image  and  to  specify 
position  and  orientation  relative  to  the  viewers.  A  model- 
based  vision  system  contains  three  uasic  phases:  fe future  extraction, 
object  modeling,  and  unknown  object  matching.  These  are  discussed  in  the 
three  subsections  that  follow. 


A.  FEATURE  EXTRACTION  (PREPROCESSING) 

Using  effective  features  in  object  recognition  is  a  very 
important  factor  for  success.  Features  can  be  used  to 
describe  or  synthesize  objects.  Features  of  an  object  are 
most  often  boundaries  and  geometric  measurements  derived  from 
boundaries.  These  features  can  be  roughly  classified  into 
three  types:  global,  local,  and  relational  features. 

•  Global  features  include  area  (size) ,  perimeter,  centroid, 
distance  of  contour  points  from  the  centroid,  curvature 
and  moment  of  interia,  and  others  which  provide  useful 
information  for  object  manipulation.  The  representation 
of  an  object  with  these  global  features  can  be  stored  in 
a  feature  lists,  and  the  ordering  of  the  features  in  the 
feature  list  is  not  important. 

•  Local  features  include  line  segments,  arc  segments  with 
constant  curvature  and  corner,  each  describing  a  portion 
of  the  object.  They  are  organized  in  a  highly  structured 
manner,  such  as  an  ordered  list  or  a  sequence  of 
equations.  The  ordering  of  the  feature  in  this  highly 
structured  manner  is  usually  related  to  the  object's 
boundary. 

•  Relational  features  include  a  variety  of  distance  and 
relative  orientation  measurements  relating  substructures 
and  regions  of  an  object.  Geometric  relations  among 
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corner  and  line)  may  be  of 


local  features  (e.g., 
particular  interest. 

Typical  feature  extraction  techniques  are  the  following: 

1.  Fourier  Descriptor  Technique 

Fourier  series  representation  of  the  parameterized 
boundary  is  one  of  the  oldest  and  most  well  known  tran<^form 
technique.  A  finite  number  of  harmonics  of  the  Fourier 
descriptors  are  computed  from  the  pattern  boundary  and 
compared  with  a  set  of  reference  Fourier  descriptors.  This 
description  is  global  in  nature,  i.e.,  each  coefficient 
depends  on  every  other  point  of  the  boundary.  It  is  therefore 
not  suitable  for  recognition  of  partially  occluded  objects. 
A  minimum-distance  classification  rule  can  be  used  for  the 
recognition  of  '/arious  parts.  [Ref.  I] 

2.  Moment  Techniques 

Moment  techniques  use  parameters  calculated  from  the 
pattern  interior  points.  In  these  techniques,  coordinates  of 
points  belonging  to  the  pattern  are  used  to  compute  a  set  of 
moments.  These  moments  can  be  normalized  to  obtain  measures 
that  are  invariant  under  scaling  and  rotation  [Ref.  3].  It 
is  difficult  to  relate  higher  order  moments  to  the  pattern. 
This  requires  global  feature  extraction,  so  the  moment  techniques 
have  a  shortcoming  in  ra":ognizing  partially  occluded  objects. 
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3 .  Technique  of  Accximulating  Local  Evidence  by  Clustering 

Directed  edge  elements  (vectors)  are  used  as  one  type 
of  primary  feature  which  contains  directional,  positional,  and 
size  information.  First,  point  features  (i.e.,  the  head  and 
tail  of  a  vector)  are  extracted,  and  then  vectors  are  formed 
from  suitable  point  pairs.  Straight  edge  detectors,  curved 
edge  detectors,  circle  detectors,  and  intersection  detectors 
are  employed  to  define  vectors  between  point  pairs.  Holes  are 
detected  by  a  set  of  circular  masks  and  curves  and 
intersections  are  detected  by  linking  edges  together  [Ref.  4]. 

Overall,  using  local  features  has  the  following 
advantages: 

•  Local  features  may  be  cheaper  to  compute  because  they  are 
simpler  and  can  be  selectively  (sequentially)  detected; 

•  If  a  few  local  features  are  missing  (due  to  noise  or 
occlusion) ,  it  may  still  be  possible  to  recognize  the 
object  on  the  basis  of  the  remaining  features  associated 
with  the  object; 

•  Since  a  few  types  of  local  features  are  often  sufficient 
to  describe  a  large  number  of  complex  objects,  it  is 
possible  to  specify  only  a  few  number  of  local  feature 
detectors  which  can  be  applied  to  the  image. 

B.  MODELING  (TRAINING/LEARNING) 

Modeling  is  based  on  the  object's  geometric  properties 
such  as  object's  shape  and  surface  relative  to  the  viewing 
angle.  The  three  basic  types  of  features  (the  global  feature, 
the  local  feature,  and  the  relational  feature)  are  then 
employed  to  describe  or  represent  objects. 


Possible  modeling  schemes  include rad/i/s-ang/e  representation, 
orientation-arc  length  representation,  curvature-arc  length  representation. 

1.  Radius-angle 

The  radius-angle  representation  requires  a  reference 
origin.  This  is  usually  taken  to  be  the  object's  centroid. 
This  representation  is  obviously  scale-dependent.  The  need 
for  a  reference  origin  (global  feature)  also  makes  it 
unsuitable  for  recognizing  partially  occluded  objects.  Also 
the  need  for  the  representation  to  be  single-valued  further 
restricts  the  type  of  shapes  that  can  be  modeled  in  this 
manner. 

2.  Orientation-arc  Length 

The  orientation-arc  length  representation  models  the 
angle  made  between  a  fixed  axis  and  a  tangent  to  the  boundary 
as  a  function  of  the  arc  length.  This  representation  is  scale 
invariant  but  not  orientation  invariant.  Straight  horizontal 
lines  or  this  representation  correspond  to  zero  curvature 
(i.e.,  straight  lines  in  the  boundary),  and  straight  non¬ 
horizontal  lines  correspond  to  segments  of  circles  with  the 
radii  or  curvature  given  by  the  slopes  of  the  lines.  (This 
allows  the  boundary  to  be  easily  segmented  into  straight  lines 
and  circular  arcs  and  is  used  sometimes  in  the  initial 
processing  for  feature  matching) . 


5 


3 .  Curvature-arc  Length 

The  curvature-arc  length  representation  models  the 
curvature  of  the  boundary  as  a  function  of  arc  length.  This 
representation  is  orientation-invariant  but  unfortunately  it 
is  not  scale  independent.  (A  circle  of  radius  r,  for  example, 
has  a  curvature  of  1/r) .  Also,  curvature  is  very  sensitive 
to  noise.  However,  curvature  is  a  popular  descriptor  and  this 
representation  is  often  used  to  extract  the  extremes  (in 
curvature)  for  feature  matching  [Ref.  5]. 

A  discrete  version  of  orientation-arc  length 
representation  has  also  been  used.  Commonly  called  chain 
codes,  this  models  the  boundary  in  short  line  segments  that 
lie  on  a  fixed  grid  with  a  fixed  set  of  orientations. 
Although  efficient  in  representation  and  cross-matching,  chain 
codes  are  rather  sensitive  to  noise  and  have  other 
shortcomings  that  make  this  representation  unsuitable  for 
general  shape  matching. 

It  should  be  noted  that  none  of  the  representations 
discussed  above  is  simultaneously  scale  and  orientation- 
invariant. 

C.  MATCHING  (RECOGNITION) 

Given  a  set  of  models  that  describe  all  aspects  of  an 
object  to  be  recognized,  the  process  of  model-based 
recognition  consists  of  matching  features  extracted  from 
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unknown  objects  of  a  given  input  image  with  respect  to  those 
of  the  models.  Matching  techniques  using  global,  local  or 
relational  features  provide  a  way  to  recognize  and  locate  a 
part  on  the  basis  of  a  few  key  features.  Therefore,  the  model 
description  dominates  other  procedures  in  the  model-based 
matching  process.  The  choice  of  matching  process  is  highly 
dependent  on  the  type  of  model  used  for  object  representation. 

We  divide  matching  processes  into  three  schemes:  statistical 
matching,  graph  matching,  and  syntactic  (structural)  matching.  Models  using 
global  features  are  usually  associated  with  statistical 
matching  techniques.  Models  based  on  local  features  are 
usually  associated  with  syntactic  matching  techniques,  and 
models  using  both  local  and  relational  features  are  usually 
associated  with  graph  matching  techniques.  Table  1  summarizes 
the  techniques  used  in  three  phases  of  the  model-based 
matching  procedure. 

1.  Statistical  Matching 

Statistical  pattern  recognition  can  be  divided  into 
non-parametric  and  parametric  methods.  Non-parametric 
classification  uses  separation  of  clusters  in  feature  space 
and  to  recognize  pattern  classes.  Parametric  classification 
on  the  other  hand,  is  based  on  Bayes  rule.  It  states  that  the 
input  feature  vector  belongs  to  a  particular  class,  say  j,  if 
the  likelihood  ratio  (A)  between  two  pattern  classes  i  and  j 
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Table  1.  THE  THREE  METHODS  BASED  ON  2-D  IMAGE 
REPRESENTATIONS . 


^PHA^ 

Feature  extraction 

Modeling 

Matching 

T 

E 

Global  scalar 

Feature  vector 
(unordered) 

Statistical  pattern 
recognition 

C 

H 

N 

Ordered  string 

Syntactical 

1 

Local 

of  features 

or  voting 

Q 

or  abstract 

verification 

U 

description  of 

of  string 

E 

S 

feature  string 

description 

Local 

and 

Relational  graph 

Graph  searching 

relational 

is  greater  than  the  ratio  of  the  probabilities  of  occurrence 
of  the  pattern  classes  j  over  i. 

For  example,  consider  two  classes  wj  and  W2  with  a  priori 
probabilities  Pj  and  P2  where  (Pj  +  Pz  =  l)  .  The  Bayes 
discriminant  function  fizix)  defining  the  decision  boundary 
between  class  1  and  2  has  the  form 

-  PlHw,,dt)p{x/u2)]  >0  (1) 

where 

1,2,  (2) 
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is  the  loss  incurred  with  the  decision  dj  when  the  i-th  class 
is  true,  and 

2 

P[^)  =  Z  ( 3 ) 

i=l 

and  Pixl^O  and  represent  the  conditional  probability 

densities  associated  with  measurement  xi  given  the  unknown 
pattern  that  came  from  class  or  respectively.  If  fi2{x) 
>  0,  we  decide  that  x  belongs  to  the  1st  class;  if  f^xix)  <  0/ 
decide  the  2nd  class. 

It  is  evident  that  Bayes  rule  is  based  on  a  priori 
knowledge.  In  practice,  the  collection  of  all  the  priori 
statistical  data  becomes  a  serious  problem. 

2.  Syntactic/Structural  Technique 

In  syntactic  methods,  an  object  model  is  represented 
by  using  abstracted  and  precise  geometric  primitives  such  as 
arcs,  lines  and  corners.  These  primitives  are  local  in 
nature,  each  describing  a  portion  of  the  object.  They  are 
organized  in  a  highly  structured  manner,  such  as  an  ordered 
list  or  a  sequence  of  equations.  The  ordering  of  primitives 
in  this  type  of  method  is  usually  related  to  the  object's 
boundary  in  such  a  way  that  following  the  entire  primitive 
list  sequentially  is  equivalent  to  tracing  the  boundary  of  the 
object.  Recognition  uses  a  hypothesis-verification  procedure. 
The  structural  local  primitives  of  the  model  are  used  to 
predict  where  objects  are  located  in  the  scene.  Then, 
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primitives  of  the  hypothesized  object  are  measures  on  the 
basis  of  the  prediction  hypothesized  in  the  model,  in  order 
to  verify  and  find  the  match. 

In  this  type  of  matching,  the  local  primitives  are 
transformed  into  primitives  which  are  organized  into  strings 
(sentences)  by  some  highly  structured  grammatical  rules. 
Matching  is  performed  by  parsing.  A  major  problem  with  the 
grammatical  model  is  the  construction  of  a  grammar  that  is 
comprehensive  enough  to  generate  all  the  possible  types  of 
shapes  of  interest  and  yet  discriminatory  enough  to  reject 
others.  The  grammatical  model  is  inherently  one-dimensional. 
Noise  perturbation  of  the  model  is  also  detrimental.  A  number 
of  grammars  have  been  developed  over  the  years.  A  good 
description  of  these  can  be  found  in  Reference  6. 

3.  Relational  Graph  Method 

Objects  can  be  represented  structurally  by  graphs. 
In  this  method,  relationships  among  local  geometric  primitives 
are  represented  by  a  graph.  In  the  graph  each  node  represents 
a  local  geometric  primitive  and  is  labeled  with  a  list  of 
properties  (e.g.,  size)  of  the  geometric  primitive.  Arcs 
represent  relational  primitive  linking  pairs  of  nodes  and  are 
labeled  with  lists  of  relation  values  (e.g.,  distance  and 
adjacency) .  Recognition  of  the  object  becomes  a  graph¬ 
matching  process.  A  disadvantage  with  this  type  of  method  is 
the  fact  that  a  large  number  of  geometric  primitives  must  be 
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detected  and  grouped  together  to  recognize  an  object.  Thus 
the  matching  algorithm  used  with  these  models  must  be  more 
complex  and  may  be  slower  than  matching  algorithms  used  with 
the  other  methods.  Noises  in  the  geometric  primitives  may 
change  the  graph  of  the  unknown  object.  No  precise  analytic 
treatment  of  the  noise  problem  is  currently  known. 

4 .  Voting  Match  Techniques 

A  technique  which  is  different  from  the  traditional 
techniques  discussed  above  is  the  Voting  Match  techniques.  In 
this  technique  an  object's  model  is  defined  first  by 
transforming  the  object's  local  features  into  an  abstract 
vector  set.  That  is,  the  model  representation  is  condensed 
to  lower  dimensional  vector  sets  which  preserve  the 
geometrical  characteristics  corresponding  to  the  original 
feature  vectors.  Matching  is  done  using  an  accumulator  cell 
to  collect  the  strength  of  instances  of  occurring  objects, 
that  is,  to  increment  a  vote  whenever  a  match  between  the 
unknown  scene  and  the  model  occurs.  The  procedure  matches  all 
possible  instances  of  the  image  and  the  model  features  on  the 
basis  of  local  evidence.  From  the  peak  strength  in  the 
accumulator  cell  the  candidacy  of  the  model  can  be  picked  up. 
Then,  for  verification,  a  line-drawing  version  of  the  object 
will  be  performed.  This  method  is  believed  to  be  more  robust 
because  the  voting  procedure  integrates  all  local  information 
before  any  recognition  decision  is  made. 
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There  are  two  typical  voting  match  techniques.  These 
are  Hough  transform  method  and  Affine  transform  method.  Both 
use  geometric  transformations  to  map  instances  of  a  given 
pattern  into  peaks  of  a  transform  space. 

The  Hough  transform  method  was  originally  developed 
to  handle  simple  pattern  such  as  straight  lines  and  circles, 
but  it  was  recently  extended  to  arbitrary  shapes  [Ref.  7]. 
This  technique  can  be  summarized  as  follows.  For  the 
reference  pattern,  code  the  boundary  with  respect  to  a  fixed 
reference  point.  For  the  test  pattern,  use  this  coding  to 
reconstruct  the  possible  locations  of  the  reference  point. 
The  possible  locations  are  thus  obtained.  If  the  two  patterns 
are  identical,  there  would  be  a  peak  at  the  location  of  the 
original  reference  point. 

In  this  form,  the  Hough  transform  method  has  several 
limitations.  It  requires  the  reference  and  test  objects  to 
be  of  the  same  scale  and  orientation.  To  account  for 
orientation,  the  above  procedures  must  be  repeated  for  every 
orientation  to  be  distinguished.  Thus  computational 
complexity  increases  rapidly  if  it  is  necessary  to  deal  with 
variations  in  scale  and  orientation.  A  more  serious  objection 
is  that  the  transform  suffers  from  false  peaks  in  the 
accumulator  array  due  to  random  matches  caused  by  noise  or 


distortion. 


In  the  Affine  transform  method,  the  same  voting 
technique  is  used  as  that  in  the  Hough  transform  method. 
However,  it  does  not  have  the  shortcomings  such  as 
translation,  orientation  and  scale  variant  problems, 
or  misrecognition  due  to  false  peaks.  Therefore  the  Affine 
transform  method  is  often  preferred.  The  Affine 
transformation  mathematically  is  an  automorphism.  An 
automorphism  of  a  mathematical  structure  is  always  a  one-to- 
one  mapping  of  that  structure  onto  itself  which  preserves  its 
structural  properties.  Therefore,  Affine  geometry  could  be 
called  the  geometry  of  parallelism,  that  is.  Affine  geometry 
has  the  characteristics  of  parallelism  and  the  preserving  of 
the  ratio  of  parallel  line. 

In  object  recognition  terms,  any  two  different  top 
view  images  of  the  same  flat  object  are  in  an  Affine  2-D 
correspondence.  The  Affine  transform  method  involves  a 
nonsingular  2x2  matrix  A  and  2-D  (translation)  vector  b, 
such  that  each  point  x  in  the  first  image  is  translated  to  the 
corresponding  point  Ax  +  b  in  the  second  image.  Our  problem 
in  this  thesis  is  to  find  the  identity  of  objects  in  the  scene 
and  the  Affine  transformation  between  their  locations  in  the 
scene  and  the  stored  models.  The  study  is  concentrated  on 
recognition  of  flat  rigid  objects.  However,  this  method  can 
be  extended  to  general  and  3D  objects.  More  detail  about  the 
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Affine  transformation  method  will  be  addressed  in  the 
following  chapters. 

In  Chapter  II  there  is  a  discussion  of  the  basic 
concept  of  Affine  invariant  transform  illustrated  through 
translation,  rotation  and  enlargement  of  an  arbitrary  incoming 
sensed  pattern.  Motivated  by  this  concept,  a  model-based 
object  recognition  system  was  developed.  Chapter  III  details 
the  algorithm  and  the  system  implementation  that  consists  of 
three  general  object  recognition  phases:  feature  extraction 
(preprocessing) ,  object  modeling  and  object  matching  (recognition) .  Chapter  IV 
d:  scusses  possible  ways  to  improve  the  system  performance  and 
discussion  of  topics  for  further  study.  The  Pascal-like 
pseudo  code  programs  are  included  in  Appendix  A  to  explain  the 
implementation.  Appendix  B  contains  the  entire  Affine 
invariant  object  recognition  system  source  codes. 
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II.  AFFINE  INVARIANT  MATCHING 


The  occluded  or  overlapped  object  recognition  problem  has 
received  more  attention  recently  in  the  object  recognition 
community.  A  recognition  technique  that  can  identify  an 
occluded  object  is  discussed  in  this  chapter.  To  understand 
many  of  the  concepts  involved  in  this  work,  a  basic  background 
for  the  Affine  transformation  is  presented.  The  application 
of  Affine  transformation  in  the  object  recognition  through 
match  and  voting  techniques  is  also  discussed. 

A,  PARTIAL  MATCHING 

In  the  industrial  robotic  vision  application,  parts  often 
appear  to  be  occluded  to  the  sensor.  Occluded  objects  are 
difficult  to  recognize  by  using  the  traditional  or  global 
feature  recognition  method.  Object  recognition  techniques 
using  global  feature  need  to  know  the  complete  information 
representing  or  describing  the  objects.  Once  some  portions 
are  covered  by  other  objects,  the  information  will  cause  the 
recognition  to  fail.  Accordingly,  it  is  necessary  to  describe 
our  objects  by  a  set  of  local  features.  This  situation  is 
applicable  to  the  human  vision  system,  which  is  also  capable 
of  recognizing  the  object  in  the  presence  of  considerable 
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occlusion.  The  local  features  can  be  points,  line  segments, 
curve  segments,  borders,  or  other  structures  obtained  from 
feature  extraction. 

Initially,  attention  is  restricted  to  the  use  of  special 
points  of  the  boundary,  which  we  denote  as  interesting  points  The 
point  sets  of  the  various  objects  are  matched  against  the 
point  set  of  the  composite  overlapping  test  object  using  a 
small  number  of  corresponding  points.  To  elaborate  upon  these 
views,  one  particular  geometrical  transformation  with  a  unique 
mapping  characteristic  is  used.  That  is  the  Affine 
coefficient  invariant  transformation  discussed  below. 

B.  AFFINE  TRANSFORMATION  AND  VOTING  TECHNIQUE 
1.  Affine  Coefficient 

The  interesting  point  set  can  be  transformed  to  an  Affine 
coefficient  pair  Any  three  non-collinear  points  can 

uniquely  specify  a  plane.  The  rest  of  the  points  of  that 
plane  can  be  expressed  in  terms  of  these  three  points.  This 
representation  is  in  terms  of  the  Affine  coefficient  pair  (C,r?). 

The  objects  to  be  recognized  in  our  system  are  assumed 
to  be  planar  objects.  The  known  objects  are  stored  as  models 
in  the  data-base  in  advance.  Recognition  of  test  object  by 
comparing  it  to  the  models  is  based  on  two  different  sets  of 
Affine  coefficients  which  are  obtained  from  the  test  object  and  the 
models  respectively.  Figure  1  shows  this  concept  graphically. 
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AFFINE  COEFFICIENT  MATCHING 


MATCH?? 


Figure  1.  The  Concept  of  Recognition  in  Affine  Coefficient 


Space. 
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2.  Affine  Coefficient  Transform 

Affine  coefficient  matching  is  one  of  the  important 
matching  techniques.  It  is  motivated  by  the  fact  that  any 
Affine  transformation  of  a  plane  [Ref.  8]  is  uniquely  defined 
by  knowledge  of  three  non-collinear  points  (or  triplet)  in  the 
plane.  The  Affine  transformation  is  always  unique;  it  maps 
any  non-collinear  triplet  in  one  plane  to  another  non- 
collinear  triplet. 

To  illustrate  the  "invariant"  characteristic  of  the 
Affine  transformation,  consider  the  following  example.  For 
the  pattern  of  Figure  2,  there  are  four  vertices  A=(0,0), 
B=(0,1),  C=(1,0)  and  D=(1,0).  Point  D  can  be  expressed  by 
points  A,  B  and  C  (i.e.,  triplet),  through  the  representation. 

D  =  UB  -  A)  +  r,  {C  -  A)  +  A  (4) 


i.e., 


(1,0)  =  a(0,l)  -  (0,0)]  +  »7[(1,2)  -  (0,0)]  +  (0,0)  (5) 

Solving  for  the  unknown  variables  ^  and  rj ,  we  get 

i  =  -2, n  =  1 

To  show  the  characteristic  of  this  transformation,  let  us 
examine  the  following  cases, 
a  Case  /:  Translation 

Assume  that  there  is  a  translation  applied  to  the 
original  pattern  in  Figure  2.  The  translation  of  the  original 
pattern  is  accomplished  by  adding  1  to  the  coordinate  of  each 
vertices  and  results  in  Figure  3.  In  Figure  3,  points  A',  S’, 
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Figure  3.  Translated  Pattern. 


C’,  and  D'  correspond  to  A,  B,  C  and  D  respectively  and  have 
coordinates  A'  =  (1,1),  8’=  (1,2),  C'=  (2,3)  and  D'  =  (2,1). 
Point  D’  can  also  be  expressed  by  A',  B'  and  C’  as: 

D’  =  ^  (B’  -  A’)  +  niC  -  A')  +  A'  (6) 

i.e.  , 

(2,1)  =  a(l,2)  -  (1,1)]  +  »;[(2,3)  -  (1,1)]  +  (1,1)  (7) 

Solving  for  the  unknown  we  again  obtain 

e  =  ~2,n  =  1 

It  is  seen  that  the  Affine  coefficient  pair  remains  the  same 
in  this  case. 

b.  Case  II:  Rotation 

Figure  4  shows  the  result  of  adding  1  and  rotating 
the  original  pattern  by  90°.  Now,  A'  =  (2,3),  8=  (2,2),  C  = 
(1,1)  and  D'  =  (1,3).  Point  O'  can  again  be  expressed  in  terms 
of  A',  8'  and  C'  as: 

D’  =  i(B’  -  A')  +  n(C'  -  A’)  +  A’  (8) 

i.e.  , 

(1,3)  =  ^[(2,2)  -  (2,3)]  +  »7[(1,1)  -  (2,3)]  +  (2,3)  (9) 

Solving  for  the  unknowns  again,  we  get 

4  =  -2,»7  =  1 

The  Affine  coefficient  pair  is  still  the  same  as  before. 

c.  Case  III:  Enlargement-Scale  Change 

The  combined  effect  of  translation,  rotation,  and 
enlargement,  which  is  generated  from  the  original  pattern  by 
adding  1  (translation),  rotating  90°,  and  multiplying  by  2 
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Figure  4.  Pattern  After  Rotation. 

(enlargement)  is  shown  in  Figure  5.  Here,  the  vertices  are 
A’  =  (4,6),  6'  =  (4,4),  C’  =  (2,2)  and  0’  =  (2,6).  Point  0'  can 
also  be  expressed  by  A',  S',  and  C'  as: 

D'  =  ^(S'  -  4’)  +  f7(C'  -  A)  +  4'  (10) 

i .  e .  , 

(2,6)  =  a(4,4)  -  (4,6)]  +  v[{2,2)  -  (4,6)]  +  (4,6)  (11) 

Again  we  find 

C  =  -2,t,  =  1 

In  all  those  four  cases,  ^  and  r]  are  exactly  the 
same.  We  have  illustrated  the  invariant  property  of  the 
transformation  in  the  above  cases.  That  means  that  the  Affine 
coefficient  pair  (C,»?)  does  not  change  in  those  four  cases. 
The  Affine  invariant  matching  technique  studied  in  this  thesis 


is  based  on  this  property. 
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Figure  5.  Pattern  After  Translation,  Rotation  and  Enlargement. 

For  a  test  object  in  the  scene,  we  can  exploit 
this  property  to  represent  those  points  of  the  test  object  in 
terms  of  their  Affine  coefficients  which  are  invariant  to 
similarity  transformations.  That  is,  we  change  the  object 
representation  from  the  interesting  point  representation  of 
the  original  plane  (the  higher  dimension  representation)  to 
a  representation  based  on  the  non-collinear  triplet  (the  lower 
dimension  representation) .  In  this  coefficient  space,  it  is 
possible  to  apply  search  and  voting  techniques  to  recognize 
the  test  objects. 

C.  AFFINE  INVARIANT  RECOGNITION  ALGORITHM 

The  Affine  coefficient  invariant  property  was  illustrated 
in  section  II. B. 2.  It  is  possible  to  exploit  this  property 
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to  recognize  planar  objects.  We  divide  the  recognition 
process  into  two  separate  procedures.  The  first  procedure  is 
Modeling  (encoding) .  The  second  procedure  is  the  Recognition  (Matching) . 
The  Modeling  procedure  has  two  phases:  preprocessing  and  data-base  setup . 
The  recognition  procedure  has  three  phases:  Preprocessing,  Data-base 
access  and  Voting  match.  The  purpose  of  the  Preprocessing  is  to  extract 
a  set  of  interesting  points  from  the  object-  It  is  used  both  in  the 
Modeling  procedure  and  the  recognition  procedure .  The  Date-base  setup 
includes  choosing  three  arbitrary  non-collinear  points 
(triplet)  as  an  Affine  basis  and  generating  the  coefficients 
^  and  *7 .  These  are  used  as  index  keys  to  create  a  search 
table  with  the  triplet  as  its  content.  In  the  Recognition 
procedure  the  Affine  coefficient  of  the  interesting  points  of 
the  test  object  (^,r))  is  also  used  as  the  index  keys  to  search 
the  previously  created  table.  When  there  is  a  match,  we 
increment  a  vote.  The  total  vote  will  be  used  to  decide 
whether  the  basis  of  the  test  object  is  the  one  corresponding 
to  that  of  the  model . 

1.  Preprocessing  (Feature  Extraction) 

This  phase  is  done  to  extract  features  for  either  the 
models  in  the  date-base  or  the  test  patterns.  These  features 
can  be  points,  line  segments,  curve  segments,  etc.,  as 
mentioned  in  Chapter  I.  In  general,  the  more  features 
extracted,  the  more  detail  it  is  possible  to  describe  a  model. 
Hopefully,  with  more  features,  more  accurate  recognition  can 


be  achieved.  However,  this  approach  will  increase  computation 
complexity.  Using  the  extracted  features,  a  model 
approximation  is  formed,  using  the  set  of  interesting  points 
for  each  object  model.  Since  the  image  is  assumed  to  be  flat, 
only  one  set  of  interesting  points  is  involved.  For  3-D 
objects,  it  may  be  necessary  to  extract  several  sets  of 
interesting  points,  one  for  each  orthogonal  projection  of  the 
object.  Smoothing  and  data  reduction  are  also  two  of  the 
primary  effects  in  feature  extraction.  The  thesis  work 
studied  here  will  not  emphasize  the  feature  extraction  phase.  The 
processing  steps  will  be  discussed  in  more  detail  in  section 
III. A. 

2.  Data-Base  Setups  (Modeling) 

This  phase  is  the  second  step  in  the  Modeling  (encoding) 
procedure  where  creation  or  update  of  the  model  data-base  is 
accomplished.  The  objective  of  this  phase  is  to  encode  models 
in  the  data-base  and  to  create  the  search  table.  Each  model 
object  is  represented  by  a  set  of  local  feature  interesting 
points  which  were  obtained  from  the  Preprocessing.  A  total  of  m 
interesting  points  are  extracted  from  the  model,  (i.e.,  the  model 
points) .  These  model  points  approximate  the  object  in  a 
special  form.  For  each  ordered  non-coll inear  triplet  of  model 
points  the  coefficient  {i,v)  of  all  the  rest  of  the  m -  3  model 
points  are  computed.  Taking  this  triplet  as  an  Affine  basis 
in  the  2-D  plane,  the  other  points  can  be  represented  as 
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V  =  ^(eio  -  eoo)  +  r;(eoi  -  Soo)  +  Soo  (12) 

where  eoo»  ©oi/  ®io  the  three  selected  non-collinear  points. 
Application  of  an  Affine  transformation  T  described  in  section 
II. B. 2.  will  change  the  point  v  to 

Tv  =C(7’eio  -  TBoo)  +  n  (Te^o  "  T^oo)  +  TBoo  (13) 

Hence,  Tv  still  has  the  same  coefficient  (|,»7)  on  the 
new  triplet  basis  Teoo,  Te^^,  Teoi.  Each  such  coefficient  is 
used  as  an  index  to  access  the  search  table.  The  entry  of 
this  search  table  may  have  a  variable  number  of  ordered  pair, 
{modeUd ,  basis-tripletid)  .  The  ordered  pairs  helps  to  access  the 
vote  array  to  register  the  basis-triplet  by  which  the 
coefficient  was  obtained.  Some  detail  of  the  search  table  is 
shown  in  Table  2.  This  is  a  conceptual  table  mainly  used  to 
illustrate  the  algorithm.  The  actual  implementation  is 
different  in  detail.  That  will  be  discussed  in  the  next 
chapter. 

3 .  Voting  Match 

In  the  recognition  procedure  a  test  object  is  given 
in  a  scene.  First,  the  interesting  points  of  this  test  object 
(say  we  have  n  interesting  points)  have  to  be  extracted.  An  arbitrary 
ordered  test  triplet  of  the  interesting  points  of  the  test 
object  is  selected.  Based  on  the  test  triplet,  the  Affine 
coefficient  of  the  other  points  can  be  calculated.  The  search 
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table  consists  of  entries  indexed  by  Each  entry  may 

have  a  variable  number  of  records  of  ordered  pair  {modelid ,  basis- 

Table  2.  CONCEPTUAL  SEARCH  TABLE  FORMAT. 


1ST  AFFINE 
COEFFICIENT 
(KEY1.KEY2) 

(MODELIDJRIPLETID) 

VOTE 

(MODELIDJRIPLETID) 

VOTE 

1 

2ND  AFFINE 

COEFFICIENT 

(KEY1.KEY2) 

(MODELIDJRIPLETID) 

VOTE 

(MODELIDJRIPLETID) 

VOTE 

1 

3RD  AFFINE 
COEFFICIENT 
(KEY1,KEY2) 

(MODELIDJRIPLETID) 

VOTE 

(MODELIDJRIPLETID) 

VOTE 

1 

1 

tripletid)  ,  where  the  model  field  is  an  integer  for  model 
identification  and  the  basis-triplet  field  is  the  model  triplet  used 
as  the  Affine  basis  for  the  model.  Associate  with  each  record 
of  ordered  pairs  is  a  vote  array  called  "vote."  This  is 
initialized  to  zero. 

During  the  recognition  procedure,  for  each  Affine 
coefficient  pair  {^,ri)  the  search  table  created  in  the  Data-Base 
Setup  phase  is  accessed  and  those  vote  fields  are  also  tallied. 
For  each  entry  of  the  table,  different  {modelid,  basis-tripletid) 
pairs  with  the  same  (^,>7)  are  accessed  and  the  entries  of 
"vote"  are  incremented  by  one.  If  the  entry  of  the  search 
table  scores  a  large  enough  number  of  votes,  all  ordered  pairs 
of  this  entry  become  possible  candidates  to  match  the  test 
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object.  The  next  step  is  to  decide  which  of  the  ordered  pairs 
(i.e.,  which  model)  will  be  the  real  matched  one.  The 
selection  process  is  based  on  the  fact  that  the  model  with  the 
maximum  accumulated  vote  is  the  matched  model.  The  model 
triplet  of  the  ordered  pair  of  the  maximum  accumulated  vote 
then  corresponds  to  the  one  chosen  for  the  test  object.  The 
uniquely  identified  Affine  transformation,  between  the  model 
triplet  and  the  test  triplet,  is  the  selected  transformation 
between  the  model  and  the  object.  Using  the  selected  model 
triplet  and  all  entry  of  the  pairs  (f,»7)  associated  with  this 
selected  maximum  vote  model  triplet,  it  is  possible  to 
reconstruct  the  recognized  model  in  the  scene.  If  the 
selected  model  triplet  and  all  of  the  associated  pairs 
do  not  match  the  dimension  of  the  model,  the  second  maximum 
vote  model  triplet  and  its  associated  pair  is  checked 

in  the  same  way.  Because  of  this  checking  procedure  the  test 
object  can  be  reconstructed  even  when  there  is  occlusion. 
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III.  ALGORITHM  IMPLEMENTATION 

A.  SEARCHING 

Searching  plays  an  important  role  in  the  Affine  recognition 
procedure.  It  is  necessary  to  search  the  table  shown  in  Table 
2.  Search  is  dependent  on  the  index  or  search  key.  This  is 
a  content  dependent  search.  The  objective  of  the  search  is 
to  collect  the  instances  (basis-triplet)  of  the  models  which 
occurred  in  the  test  object.  The  more  instances  of  the  model 
occurring  in  the  test  object,  the  more  confident  will  be  the 
decision  which  shows  what  part  of  the  test  object  resembles 
the  model.  Content  dependent  search  is  inherently  slow. 
Therefore,  special  techniques  are  needed  to  speed  up  this 
procedure. 

B.  HASH  TECHNIQUE 

In  the  recognition  procedure,  the  result  of  the  Affine 
transformation  of  the  interesting  points  is  actually  a  pair 
of  real  coefficient,  i.e.,  By  multiplying  it  with  a 

constant,  this  pair  of  coefficients  can  be  added  to  generate 
the  key,  i.e.,  inkey,  in  this  system.  Since  the  quantized  real 
coefficient  is  somehow  random,  it  is  not  desirable  to  use 
sequential  array  data  structure  like  those  shown  in  Table  2. 
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The  storage  overhead  and  speed  reduction  will  be  too  severe. 
The  Hashing  technique  is  a  preferred  technique.  The  inkey  is 
associated  with  a  location  of  an  accumulator  cell .  The  accumulator  cell 
is  used  to  store  the  instance  of  the  occurrence  of  the 
candidacy  model . 

Hashing  is  a  many-to-one  mapping  that  does  not  usually 
preserve  the  order  of  the  keys  of  a  list.  Hashing  is  achieved 
by  deriving  a  hash  key  from  the  inkey  which  indicates  to  which 
sublist  or  neighborhood  a  record  belongs.  This  sublist  is 
called  a  bucket.  The  biggest  problem  is  Hashing  is  the 
difficulty  in  producing  a  relatively  uniform  number  of  records 
in  the  bucket.  When  the  keys,  inkeyl  and  inkey2 ,  of  two  distinct 
records  are  converted  to  the  same  hash  key,  there  is  a 
collision.  To  solve  this  problem  in  this  system,  it  is 
necessary  to  use  a  linked  list  to  append  the  collided  record 
after  the  last  record  in  the  bucket.  The  linked  list  is  used 
to  link  all  records  in  the  same  bucket  together  with  the  same 
hash  key . 

There  are  several  possible  Hashing  implementations.  One 
of  the  best  general  purpose  methods  is  the  division  method 
[Ref.  9].  Our  system  is  based  on  this  method.  In  this  method 
an  inkey  is  divided  by  a  number  which  is  the  table  size  in  this 
system.  Then,  the  record  is  assigned  to  the  bucket  that  is 
associated  with  the  remainder,  i.e.,  the  hash  key.  Table  size 
is  determined  by  the  possible  number  of  (^,r;)  pairs  generated 
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from  the  interesting  points  of  the  model  for  all  bases. 
Figure  6  shows  hash  key  generation  by  division. 


inkey  =  current  key  value 
hashkey  =  hashed  value 

♦ 


hashkey  =  inkey  MOD  tablesize 


Figure  6.  Hash  Key  Generation  by  Division  from  Inkey. 

1.  Hashing  Implementation 

The  algorithm  implementation  is  divided  into  two 
separate  procedures.  The  first  procedure  is  Modeling  (encoding)  . 
The  second  procedure  is  Recognition  (Matching)  .  The  Modeling 
procedure  has  two  phases:  preprocessing  and  data-base  setup.  The 
recognition  procedure  has  three  phases:  preorocessing ,  data  base 
access,  and  voting  match.  The  implementations  for  each  of  these 
modules  are  described  in  sequence.  In  preprocessing  the 
interesting  points  of  the  boundary  are  formed.  In  data  base  setup 
the  Affine  coefficient  pairs  (i,ri)  3itce  calculated  which  are 


used  to  generate  the  "Hash"  table.  In  voting  match  the  test 
object  and  models  in  the  data  base  are  compared  in  terms  of 
{modelid ,  basis-iripletid)  pair. 

C.  PREPROCESSING 

The  preprocessing  is  shown  in  Figure  7,  which  consists  of 
a  number  of  steps.  All  the  modules  in  this  phase  are  adopted 
from  the  commercial  package  SPIDER  [Ref.  10]  on  a  VAX  11/780 
system.  SPIDER  is  an  image  processing  utility  software 
package.  There  are  five  routines  written  in  FORTRAN  used  for 
preprocessing . 

1.  Laplacian  Operator  EGLP  [Ref.  10] 

The  Laplacian  function  f(X,Y)  of  two  independent 
variables  is  defined  as 


vV(x,r) 


aV(A',r)  d^f{x,Y) 

dx^  dV^ 


(14) 


The  image  intensities  change  sharply  at  places  where 
V^/(X,Y)  is  large.  The  outline  is  detected  and  obtained  from 
the  Laplacian  image  plane. 

2.  Threshold  Operation  SLTH 

This  operation  thresholds  the  output  data  of  the 
Laplacian  operator  and  generates  the  input  data  for  the 
boundary  tracing  operation  conducted  later.  That  is, 

I  256  if  VV(X,y)  >  THRESHOLD  ^^5 
j  Q  otherwise 
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Figure  7.  Preprocessing  Procedure  Control  Flowchart. 

3.  Boundary  Thinning  THN6  [Ref.  10] 

The  boundary  outline  of  the  image  is  thinned  to  a 
width  of  3  pixels. 

4.  Tracing  Boundary  BDFL  [Ref.  10] 

Boundary  tracing  is  the  conversion  from  boundary 
coordinates  to  chain  codes  [Ref.  11].  The  line  is  represented 
by  the  coordinates  of  the  starting  point  and  a  series  of  codes 
indicating  the  slope  of  the  line  segments  (or  links)  .  The 
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BDFL  algorithm  primarily  involves  raster  scan  and  tracking  of 
the  data. 

5.  Maximum  Curvature  Finding  MAXCUR 

The  interesting  points  are  taken  at  places  where  the 
chain  code  slope  is  greater  then  a  certain  threshold. 

At  the  end  of  the  preprocessing  phase,  the  interesting 
points  of  the  boundary  are  selected  from  either  the  model  or 
the  test  object. 

D.  DATA-BASE  SETUP 

The  data-base  setup  phase  is  shown  in  Figure  8 .  In  the  data-base 
setup  phase  of  the  modeling  or  encoding  procedure,  two  steps  are 
involved.  They  are  discussed  in  the  following. 

1.  Affine  Transformation 

AFFIME  is  the  first  step  in  the  data-base  setup  phase. 
From  the  interesting  points,  a  set  of  non-collinear  triplets 
is  chosen  as  an  Affine  basis.  Then  the  Affine  coefficient 
pair  {^,v)  of  the  other  points  are  calculated.  The  Affine 
coefficient  pair  (^,^7)  is  then  converted  from  real  data  type 
to  integer  type  by  multiplying  it  by  a  constant.  For  example, 
if  there  are  four  interesting  points  (XI, Yl),  (X2,Y2),  (X3,Y3) 
and  (X4,Y4),  the  fourth  point  is  expressed  using  the  other 
three  as  a  triplet  basis, 

X,  =  aXi  -  X2)  +  niXz  -  X3)  +  X3  (16) 

Y,  =  -  'iz)  +  »?(Y2  -  Y3)  +  Y3  (17) 
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Figure  8.  Data-Base  Setup  Procedure  Control  Flowchart. 


and  ^  and  r;  are  solved  from  the  above  equations.  That  is 


f f  V‘  ( 

[n  J~({ri-y>)(y2-Y,)  j  Un-n) 
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This  procedure  is  repeated  for  all  different  ordered 
triplets  (i.e.,  permutations  aria  combinations)  as  basis  until 
every  possibility  is  exhausted.  This  will  generate  an  output 
file  {hashkeydata)  .  (The  format  of  this  data  file  is  described 
in  Table  3.)  The  main  Affine  program  reads  the  interesting 
point  data  from  the  input  file  interestingdata  and  invokes  the 
following  modules  to  accomplish  the  task.  The  Pascal-like 
pseudo  code  and  source  program  of  all  modules  are  listed  in 
Appendix  A. 


Table  3.  HASHKEY  DATA  FILE  FORMAT. 


inkey 

model 

id 

triplet 

id 

key 

1 

key 

2 

moaei 
triplet  base 
X1.X2.X3 

model 
triplet  base 
Y1.Y2.Y3 

entry  1 

-20000000 

1 

1 

-1 

-1 

30,20,40 

40,30,30 

entry  2 

0 

1 

1 

1 

-1 

30,20,40 

40,30,30 

.... 

.... 

n 

.... 

.... 

entry  i 

10000000 

2 

1 

1.5 

-0.5 

40,30,20 

10,10,30 

.... 

.... 

Hi 

.... 

entry 

m 

.... 

n 

■ 

Note  :  inkey  =  10000000*  {key  1  +  key2) 
entryl  and  entry  2  belong  to  the  same  model  triplet 
a.  COMB  Module 


This  module  is  a  recursive  module  which  generates 
all  the  possible  combinations  of  triplets  from  the  input 
interesting  points.  If  there  are  m  interesting  points,  the 
total  number  of  combinations  will  be 


^  _  m{m-  l)(m-2) 

■ - 3! - 


(19) 
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For  each  combination  this  module  will  call  the  COLLINEAR 
module. 

b.  COLUNEAR  Module 

This  module  tests  the  collinearity  of  the 
combinations  sent  from  the  COMB  module.  Slopes  among  the 
points  are  checked  to  verify  the  collinearity.  If  the  test 
of  collinearity  is  not  successful,  this  module  then  calls  the 
PERM  module.  If  the  test  is  successful,  control  will  be 
returned  to  the  COMB  module  for  a  new  combination. 

c.  PERM  Module 

Given  the  combination  passed  from  the  COLLINEAR 
module,  this  module  generates  all  the  permutation.  This  is 
again  a  recursive  program.  For  each  permutation  it  calls  the 
CALCULATE-COORD  module. 

d.  CALCULATE-COORD 

This  module  calculates  the  base-matrix 

.  , .  -  x,){X2  -  X,) 

It  then  calls  the  INVERSE  module  by  passing  the  base-matrix  for 
inversion.  Then  it  calculates  the  difference  for  the  rest  of 
the  interesting  points  (Xi,YJ 

difference  =  ^  j  (21) 

This  module  then  invokes  the  MATRIX-MULT  module  to  get  the  final 
solution,  the  Affine  coefficient  pair 


(20) 
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e.  INVERSE  Module 


This  module  calculates  the  inverse-matrix,  for  the 


solution  of  ^  and  rj ,  that  is 


inverse  —  matrix  = 


(x,-x,)(x,-X3)y;^  j_/'  (K,-n)(A:,-X3)  \  ,,,, 

{Y,  -  n)  (V,  -  n)  )  del  V  (y.  -  y,){x,  -x,)  )  '  ' 


f.  MATRIX-MULT  Module 


This  module  calculates 
coefficient  pair  That  is 


f  ^0  =  f  {Xi~x2){x,-xs)  r' 
U-  /  V  (^1  -  ^2)  {Yi  -  Y3)  j 


the  final 


[Xi  -  X3)  \ 

{y-y,)  I 


Affine 


(23) 


2.  Hash  Table  Generation 

HASH  is  the  second  step  in  the  Data  base  setup  phase.  At 
the  end  of  AFFINE  execution,  the  {modeiid ,  basis-tripletid)  pairs  are 
created  and  stored  in  a  file  {bashkeydata)  with  other  support 
information  shown  in  Table  3.  This  is  an  input  file  to  the 
HASH  module . 

The  purpose  of  the  HASH  program  is  to  read  the  input 
file  hashkeydata  and  create  the  Hash  table  with  the  format  as 
shown  in  Table  4.  The  Hash  table  is  a  linked  list  structure. 

Each  record  has  extra  fields:  hashkey,  inkey,  and  link. 
This  structure  is  the  actual  implementation  used  in  the 
experiment;  it  is  different  from  the  search  table  in  Table  2 
used  for  conceptual  illustration.  The  link  field  is  used  to 
link  the  collided  records  while  the  Hash  module  maps  two  records 
with  two  different  values  of  inkey  to  the  same  hashkey.  As  an 
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example,  for  a  module  with  four  interesting  points,  the  Hash 
table  size  is  4  x  6  =  24  where  4  is  the  combinations  of  three 
out  of  four  and  6  is  the  permutations  of  three  out  of  three. 
The  main  task  of  the  HASH  module  is  to  generate  a  consistent 
Hash  table  for  the  recognition  procedure.  Three  modules  are 
called  from  the  HASH  program, 
a  INmALIZE  Module 

This  is  called  to  initialize  the  field  hashkey  and 
link  all  of  the  record  to  empty  label. 
b.  HASHING  Module 


After  initialization,  the  Hash  main  program  invokes 
the  HASHING  module  to  convert  Affine  coefficient  pair 
(i.e.,  (key1,key2))  to  inkey  by  adding  them  and  multiplying  the 
sum  with  a  constant  multiplier.  That  is; 

inkey  =  (key1  +  key2)  x  multiplier  (24) 

The  HASHING  module  also  generates  the  hashkey  as 

following; 


hashkey  =  inkey  MOD  tablesize  (25) 

The  HASHING  module  then  tests  if  the  record 
accessed  by  the  hashkey  in  the  Hash  table  has  an  empty  hashkey 
field.  If  so,  it  will  insert  the  current  record  of  the  input 
file  (hashkeydata)  into  the  Hash  table.  Otherwise  it  will  invoke 
the  collision  module. 
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c.  COLUSION  Module 


This  module  tests  to  see  if  the  accessed  record's 
link  field  of  the  Hash  table  is  empty.  If  it  is  empty,  the 
current  record  of  the  input  file  is  the  first  new-comer  into 
the  bucket  list  pointed  to  by  the  link  field.  The  current  record 
is  put  in  the  next  available  position  in  the  Hash  table.  The 
link  field  of  the  accessed  record  is  updated  to  point  to  this 
new  position.  If  the  link  field  is  not  empty,  then  using  the 
link  field,  the  module  can  find  sequentially  the  last  existing 
entry  of  the  bucket  list  and  append  the  current  record  after 
the  last  entry. 

E.  RECOGNITION 

Once  the  Modeling  (encoding)  procedure  is  accomplished,  it  is 
possible  to  start  the  recognition  procedure  of  a  test  object. 
The  flow  chart  of  recognition  procedure  is  shown  in  Figure  9. 

After  the  preprocessing,  a  set  of  n  interesting  points  of 
the  input  test  object  were  generated.  The  AFFINE  program  is 
invoked  to  process  these  points.  This  program  includes 
modules  COMBINATION,  COLLINEAR ,  CALCULATE-COORD ,  INVERSE  and  MATRIX- 
MULT  to  obtain  the  Affine  coefficient  pairs  i  = 
l,2,...,n  -  3  of  the  test  object.  Those  Affine  coefficient 
pairs  (^i,T}i)  and  the  associated  test  triplet  are  stored  in  an 
output  file  (candidatedata)  .  The  format  of  output  file 
(candidatedata)  is  shown  in  Table  5.  Inkey  is  used  to  access  the 
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Figure  9.  Recognition  Procedure  Flowchart. 

Hash  table  and  the  test  triplet  is  used  to  establish  the 
correspondence  between  the  model  triplet  of  the  Hash  table. 
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and  the  test  object  at  the  end  of  the  recognition  procedure 
for  reconstruction. 

The  objective  of  the  tally  program  is  to  accumulate 
incidences  of  correspondence  between  one  test  object's  triplet 
{candidatedata)  and  one  model  triplet.  Each  model  has  a  set  of 
triplets  and  there  could  be  multiple  models  in  the  Hash  table. 
Both  of  these  two  set  of  triplets  and  the  associated 
interesting  points  could  generate  the  same  Affine  coefficient 
pairs  This  represents  one  incidence  of  the  match. 
In  other  words,  the  Affine  coefficient  pair  generated 
by  a  test  triplet  is  used  to  access  the  Hash  table.  Matching 
between  test  triplet  and  model  triplet  is  done  in  the  Affine 


Table  5.  CANDIDATE  DATA  FILE  FORMAT. 


in  key 

key  1 

key  2 

test  triplet 
base  X 
X1,X2,X3 

test  triplet 
base  Y 
Y1,Y2,Y3 

candidate  1 

-20000000 

-1 

-1 

30,20,40 

40,30,30 

candidate  2 

0 

1 

-1 

30,20,40 

40,30,30 

candidate  3 

10000000 

1.5 

-0.5 

40,30,20 

10,10,30 

.... 

.... 

candidate  n 

.... 

Note  ;  inkey  =  10000000  *  {key  1  +  key  2) 
candidate  1  and  candidate  2  belong  to  the  same  test  triplet 


coefficient  domain.  During  the  search,  whenever  there  is  a 
corresponding  model  triplet  in  the  Hash  table  with  the  same 
Affine  coefficient  pairs  as  those  of  the  test  triplet,  this 
model  triplet  in  the  Hash  table  is  declared  to  match  the  test 
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object.  The  program  tally  first  reads  the  input  file  (candidatedata) 
of  the  test  object  into  a  record  array  (cand)  and  then  the  hash 
table  data  (nashdata)  into  the  record  array  (model)  .  Three 
modules:  SEARCH,  VERIFY,  and  RECONSTRUCT  are  involved  in  this 
program. 

1.  SEARCH  Module 

Given  a  particular  test  triplet  record  from  the  input 
file  (candidatedata),  the  Affine  coefficient  pair  (Cir'/i)  and  inkey 
are  used  to  perform  the  access  and  comparison  of  the  Hash 
table.  That  is 

hashkey  =  inkey  MOD  tablesize  (26) 

Using  the  calculated  hashkey,  a  certain  entry  of  the  created 
Hash  table  is  accessed.  If  there  is  a  match,  i.e.,  a  hit 
occurred  in  the  Hash  table,  the  corresponding  2 -dimensional 
array  vote  (modelid ,  tripletid)  shown  in  Table  4  with  the  same  (modelid, 
tripletid)  pair  is  incremented  by  one.  At  the  same  time,  the 
accessed  entry  of  the  Hash  table  is  moved  to  a  temporary 
table.  The  data  format  of  the  temporary  table  is  shown  in 
Table  6.  This  table  is  needed  later  to  reconstruct  the  model 
outline  in  the  test  object  for  graphic  presentation.  This 
entire  procedure  is  executed  iteratively  until  all  of  the 
interesting  points  of  the  test  object  based  on  the  same  test 
triplet  are  exhausted. 
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2. 


VERIFY  Module 


This  module  examines  the  2-D  array  vote  (modelid ,  tripletid) 
to  select  all  the  model  triplets  whose  accumulated  votes  are 
all  greater  than  a  given  threshold  value.  Based  on  the 
position  (modelid,  tripletid)  of  those  that  are  greater  than  the 
threshold  value,  the  model  triplets  are  selected  as  the  one 
most  possibly  corresponding  to  the  test  object's  triplet. 

Table  6.  TEMPORARY  TABLE  DATA  FORMAT. 


hashkey 

inkey 

model 

id 

triplet 

id 

key 

1 

key 

2 

accessed 

model 

triolet 

temp  1 

24 

-20000000 

1 

1 

temp2 

72 

0 

1 

1 

1 

-1 

.... 

.... 

— 

temp  i 

i 

10000000 

2 

1 

1.5 

-0.5 

"i"  is  the  number  of  the  number  of  the  test  triplet 


with  the  selected  model  triplets,  control  goes  back  to  the 
temporary  table  to  collect  all  those  Affine  coefficient  pairs 
(^i<Vi)  for  the  selected  model  triplets.  Comparison  between 
the  (modelid,  tripletid)  in  the  temporary  table  and  the  selected 
(modelid,  tripletid)  are  necessary  in  this  process. 

3 .  RECONSTRUCT  Module 

The  main  purpose  of  this  module  is  to  reconstruct  the 
model  outline  in  the  test  object  and  check  the  squared  error 
and  for  graphics  presentation.  Based  on  the  selected  model 
triplets  and  the  collected  Affine  coefficient  pair  (^i,rj^)  from 
the  VERIFY  module,  an  inverse  Affine  transformation  is  performed 


to  calculate  the  sets  of  model  coordinates  in  the  model  space. 
With  the  interesting  point  data  file  of  the  model  the  order 
of  these  points  can  be  established.  With  the  same  and 
the  test  triplet,  the  corresponding  interesting  points  in  the 
test  space  can  be  found  according  to  the  established  order. 
The  square  error  between  each  set  of  the  model  coordinates  and 
the  corresponding  interesting  points  in  the  test  space  is 
measured.  If  the  calculated  square  error  is  minimum  and  it 
is  less  than  a  given  threshold,  the  optimum  model  triplet  can 
then  be  determined.  Based  on  the  optimum  model  triplet,  the 
graphics  presentation  of  the  model  can  be  displayed  in  the 
test  scene.  In  order  to  recognize  all  the  possible  models 
existing  in  the  test  object,  after  one  model  is  recognized 
successfully,  control  goes  back  to  the  SEARCH  module  to  find 
another  peak  in  the  array  which  has  a  different  modelid  and  the 
rest  of  the  procedure  is  repeated.  If  none  of  the  calculated 
square  error  satisfies  the  given  threshold,  control  goes  back 
to  the  VERIFY  module  to  use  the  second  test  triplet  and  repeat 
the  procedure. 
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IV.  RESULTS  AND  PERFORMANCE 

A.  EXPERIMENT  RESULTS 

The  Affine  invariant  matching  technique  via  hashing  has 
demonstrated  its  characteristics  of  object  recognition  in 
several  experiments.  To  concentrate  the  effort  on  the  study 
of  the  Affine  invariant  technique  and  the  implementation  of 
the  technique  in  software,  the  model  data  and  test  data  were 
artificially  created  in  the  experiment.  Two  different  models 
shown  in  Figure  10  were  stored  in  the  data-base  after 
preprocessing  phase. 

1.  Test  For  Similarity  Transformation 

The  first  unknown  test  object  is  fed  into  the  system. 
The  test  object  and  the  recognized  model  are  shown  in  Figure 
11.  This  is  a  case  of  recognizing  objects  under  similarity 
transformations,  i.e.,  rotation,  translation  and  scaling. 

The  Affine  invariant  matching  is  obviously  successful 
in  detecting  objects  under  a  similarity  transformation. 
Similarity  transformation  is  a  special  case  of  a  general 
Affine  transformation.  The  key  observation  here  is  that  since 
the  similarity  transformation  is  orthogonal,  two  points  are 
enough  to  form  a  basis  which  spans  the  2-D  plane.  A 
similarity  transformation  occurs  in  the  situation  when  the 
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M0DEL#1 


MODEL  #2 


Figure  10.  Two  Different  Models  in  the  Data-Base. 


TEST  OBJECT  RECOGNIZED  MODEL  IS  #2 


Figure  11.  Similarity  Transformation  Case  and  Recognized 
Model. 


viewing  angle  of  the  camera  is  the  same  as  that  of  the  model. 
Sucn  a  condition  usually  occurs,  for  example,  in  a  factory 
environment  where  the  viewing  angle  of  the  camera  is  kept 
constant.  Consequently,  this  algorithm  can  be  directly 
applied  to  industrial  machine  vision. 
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2.  Test  For  Partial  Matching 

To  test  the  situation  where  model  can  be  identified 
partially,  a  test  object  of  a  composite  overlapping  scene  in 
Figure  12  of  the  two  different  models  from  the  data  base  is 
used.  The  recognition  results  are  shown  on  the  right  hand 
side  of  Figure  12. 


Figure  12.  Composite  Overlapping  Test  Objects  Scene  and 
Recognized  Model. 


Note  that  the  hidden  model's  interesting  point  can 
still  be  reconstructed  due  to  the  partial  matching 
characteristic  of  the  algorithm.  In  other  words,  the  hidden 
local  feature  such  as  the  basis-triplet  in  our  system  can  be 
recovered  or  assisted  by  the  rest  of  the  basis-triplets  during 
the  recognition  phase. 
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3.  When  Numerical  Error  is  Present  in  the  Test  Object 
If  the  coordinates  of  c  and  d  are  very  close  to  each 
other  as  shown  in  Figure  13,  c  and  d  cannot  be  part  of  the 
qualified  triplets.  The  collinearity  check  module  will 
discriminate  these  cases. 


c 

b  , - — - - 


a 

Figure  13.  Interesting  Point  Too  Close  Case. 

If  the  difference  of  c  and  d  is  significant,  the 
triplet  with  c  and  d  may  result.  A  model  triplet  like  this 
may  get  a  number  of  votes,  which  on  one  hand,  are  not  enough 
to  accept  it  as  a  "selected"  model  triplet,  but,  on  the  other 
hand,  do  not  justify  total  rejection.  It  is  possible  to 
change  this  model  triplet  to  another  model  triplet  consisting 
of  points  that  are  more  distant  from  each  other  than  those  of 
the  previous  model  triplet  points.  Even  if  a  model  triplet 
belonging  to  some  model  did  not  get  enough  votes  due  to  noisy 
data,  it  is  still  possible  to  recover  this  model  from  another 
model  triplet. 


Ic-d  I  <<l  b-cl 
OR 

I  c-d  l<  <1  b-d  I 
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B.  ALGORITHM  PERFORMANCE  AND  COMPLEXITY 


The  performance  is  highly  dependent  on  the  number  of 
interesting  points  m  existing  in  the  test  scene.  This  is  true 
as  the  data-base  model  is  changed  to  that  shown  in  Figure  14 . 
The  test  object  scene  is  shown  in  the  left  part  of  Figure  15 
and  the  recognized  model  scene  is  shown  on  the  right  part  of 
Figure  15. 


Figure  14.  Changed  Data-Base  Model. 


In  this  case  the  cpu  time  for  recognition  is  increased 
tremendously.  The  total  number  of  computation  steps  for  m 
interesting  points  in  Affine  invariant  matching  is 
proportional  to  m''  for  the  worst  case.  The  Hash  table  size  of 
order  m*  was  obtained  from 

m  X  X  3P3  =  6  X  m  X  (m  -  1)  (m  -  2)  (m  -  3)  ^  m'"  (27) 
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TEST  OBJECT  RECOGNIZED  MODEL 


Figure  15.  More  Complicate  Test  Object  and  Recognized  Model, 
where  is  the  number  of  different  combinations  of  the  Affine 
basis,  and  3P3  is  the  number  of  permutations  of  three  arbitrary 
non-collinear  points.  When  the  number  of  interesting  points 
of  the  models  is  small,  the  matching  algorithm  will  be  much 
faster.  The  computation  for  Hash  table  setup  in  the  encoding 
procedure  is  usually  done  off  line.  If  there  are  k  model 
points  in  a  test  scene  of  m  points,  then  the  probability  of 
not  choosing  a  model  triplet  in  t  trials  is  approximately 

/-  =  |1-(1)V  (28) 

m 

where  3  relates  to  three  non-collinear  points.  Hence,  for  a 
given  e  >  0,  if  we  let  the  probability  of  missing  the  correct 
triplet  P  be  less  than  e,  the  number  of  the  trials  t  is 

k 

log  e  >  logP  =  logll  -  {—}  ]  (29) 
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(30) 


that  is, 


t  < 


log  e 


logil  -  nr) 


In  the  algorithm,  the  procedure  of  recogni^-ion  repeats  itself 
for  each  of  the  selected  triplets.  The  above  ineguality 
describes  the  worst  case  number  of  trials  before  the  matching 
is  successful.  If  one  wants  the  probability  of  missing  the 
correct  triplet  to  be  small,  one  has  to  do  more  triplet 
selection.  Finding  the  interesting  points  is  also 
computationally  expensive.  For  example,  the  outline  of  a  test 
object  is  obtained  by  chain-code  in  this  system.  The  big 
curvature  change  in  the  linked  chain  is  selected  as  an 
interesting  point.  This  choice  is  pattern  dependent.  A 
polyhedral  object  in  the  scene  naturally  suggests  the  use  of 
polyhedral  vertices,  deep  concavities,  and  zero  curvature 
points.  Sometimes,  interesting  points  do  not  have  to  appear 
physically  in  the  image.  For  example,  an  interesting  point 
may  be  taken  as  the  intersection  of  two  nonparallel  lines  that 
do  not  touch  in  the  test  object.  Reducing  the  computation 
complexity  can  be  achieved  by  representing  a  line  by  only  one 
pair  of  interesting  points  if  there  are  some  other  interesting 
points  on  this  line.  This  can  help  by  reducing  the  order  of 
magnitude  n  in  the  computation.  In  general,  Affine  invariant 
matching  is  a  highly  parallel  operation.  The  input  test 
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object  can  be  compared  against  all  the  models  in  the  Hash 
table  simultaneously. 


C.  LIMITATIONS 

1.  Model  Representation 

The  major  limitation  of  a  model  based  vision  system 
is  the  low  dimensionality  in  spatial  representation  or 
description  of  models  or  test  objects.  This  restricts  the 
system's  functionality  to  a  limited  class  of  objects  observed 
from  a  few  fixed  viewpoints.  The  system  developed  here  cannot 
be  applied  to  patterns  with  both  convex  and  non-convex  curves. 
However,  the  algorithm  still  can  be  performed  in  these  cases 
by  using  the  footprint  method  suggested  by  R.  Hummel  and  H. 
Wolfson  [Ref.  1].  The  following  description  is  quoted  from 
that  paper. 

The  footprint  is  a  numerical  Affine  invariant  shape  characteristic 
that  is  a  representation  of  the  concavity  shape.  To 
compute  the  footprint,  we  first  normalize  a  concavity  by 
applying  the  transformation  which  maps  its  triplet  basis 
to  a  standard  equilateral  triangle.  That  is,  the 
concavity  endpoi..Lw  c.rc  mapped  to  (-1,0)  (1,0),  and  the 
third  point  to  (0,3°  ^).  To  each  such  normalized  shape  we 
assign  a  vector  of  numbers  that  we  call  the  'footprint.' 
One  of  the  footprint  schemes  that  we  can  use  is 
illustrated  in  Figure  16. 

For  some  constant  s  (say  5  <  s  <  10)  ,  we  divide  the 
upper  half  plane  by  s  +  i  rays  based  at  the  origin,  with 
angle  ir/s  between  two  consecutive  rays  /  and  /  +  1.  The 
footprint  will  be  s-vector  (ai,a2,  .  .  .  ,83)  ,  where  each 
component  is  quantized  into  one  of  a  number  of  discrete 
bins. 

We  now  proceed  as  before  to  construct  a  hash  table. 
Each  footprint  is  used  as  an  entry  to  the  hash  table, 
where  the  model  and  concavity  numbers  are  recorded.  In  the 
recognition  phase,  each  concavity  is  used  to  compute  a 
footprint,  and  the  appropriate  entry  in  the  hash  table  is 
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Vj 

y ' 

-1 

Tj - r - - 

Figure  16.  The  Footprint  of  a  Concavity. 


accessed.  For  each  pair,  (model,  concavity)  ,  appearing  in  the 
hash  table  as  the  location,  we  compute  the  appropriate 
Affine  transformation  to  the  associated  model,  and  attempt 
to  verify  an  instance  of  the  model  in  the  image. 

Basically  the  same  method  for  handling  polygon  shapes 
can  be  extended  to  concave  shapes. 

2.  Quantization  Problem  in  Generation  of  the  Hash  Key 

To  convert  the  Affine  coefficient  pair  to  inkey,  we 

multiply  each  of  the  Affine  coefficient  pair  ((,ri)  by  a  large 
constant  and  sum  them  up.  This  conversion  causes  most  of  the 
inkeys  to  be  equal.  Therefore,  the  generated  hashkeys  are  not 
distributed  uniformly.  These  collisions  result  in  a  long  bucket 
list.  Such  a  long  bucket  list  is  the  main  disadvantage  of  the 
present  implementation  since  it  slows  down  the  hash  table 
search  speed. 

3.  Noise  Handling 

The  searching  in  this  implementation  is  sensitive  to 
the  noise.  With  noisy  interesting  points  the  test  triplet 
will  lead  to  the  situation  where  the  Affine  coefficient  pair 
does  not  hit  the  Hash  table  due  to  the  noise.  This  is  one  of 
the  weaknesses  of  this  implementation.  Howevei  further  work 


54 


can  be  done  to  improve  the  solution  as  suggested  in  Wolfson's 
paper.  [Ref.  1]  The  following  paragraph  is  adopted  from  that 
paper. 

An  Affine  transformation  in  the  plane  is  uniquely 
defined  by  the  transformation  of  three  non-collinear 
points.  However,  in  practical  applications  this 
transformation  may  be  somewhat  distorted,  because  of  noisy 
computation  of  these  three  points.  Knowledge  of 
additional  points,  which  were  transformed  to  each  other 
may  help  to  improve  the  accuracy  of  the  computed 
transformation.  The  incorporating  of  the  Mean  Square  Error 
match  seems  to  be  one  of  the  solutions.  Specifically, 
assume  that  we  are  looking  for  an  Affine  match  between  the 
sequences  of  the  planar  points  and  where  /  = 
l,2,...,n.  By  using  the  MSB  method,  we  could  find  the 
optimal  Affine  match  T  which  will  minimize  the  square  of 
the  distance  between  the  sequence  Tu^  and  where  /  = 
1,2,  .  .  .  ,A7. 


D.  IMPRESSIONS  OF  THE  ALGORITHM  FEATURE 

1.  Two  Phase  Algorithm 

A  key  feature  of  this  algorithm  is  the  division  of 
Modeling  {Encoding)  and  Recognition  (Matching)  procedures.  The  modeling 
is  performed  off-line.  This  enables  the  speed  of  an  on-line 
recognition  procedure  to  be  optimized. 

2.  Hash  Implementation 

The  method  described  here  differs  from  other  existing 
model-based  matching  systems.  This  method  uses  hashing 
technique  to  search  for  the  Affine  coefficient.  The  speed  of 
on-line  recognition  depends  on  the  size  of  the  interesting 
points  of  the  test  object.  The  amount  of  on-line  processing 
does  not  depend  too  much  on  the  total  number  of  models 
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existing  in  the  Hash  table.  In  other  words,  the  recognition 
time  is  independent  of  the  number  of  different  models  in  the 
data-base.  This  advantage  makes  the  method  uniquely 
attractive  as  compared  to  others. 
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V.  CONCLUSION 


A.  SUMMARY 

This  thesis  begins  with  a  survey  of  various  model-based 
vision  systems.  Different  feature  extraction  methods  and 
matching  techniques  are  also  discussed.  To  achieve  not  only 
the  ability  to  recognize  partial  occluded  test  objects  but 
also  to  have  high  processing  speed,  the  Affine  invariant 
transformation  technique  is  preferred.  The  Affine  invariant 
matching  was  studied  by  R.  Hummel  and  H.  Wolfson.  [Ref.  1] 
The  Affine  invariant  matching  was  proposed  to  provide  a  high 
speed  and  the  effective  matching  technique. 

Motivated  by  this  voting  match  technique,  the  main 
objective  of  this  thesis  was  to  develop  a  local  system  that 
can  accept  an  incoming  scene  and  decide  where  known  models 
exist  in  it.  Affine  invariant  matching  handles  the  modeling 
and  matching  procedures  independently.  The  use  of  a  Hash 
table  indexed  by  possible  Affine  coefficient  pairs  allows  for 
fast  content  dependent  matching.  The  program  developed  here 
is  in  principle  similar  to  that  in  Reference  1.  Some  unique 
features  of  this  algorithm  can  be  lifted  as  follows. 

•  Encoding  and  Recognition  procedures  are  separated. 

•  Matching  can  detect  objects  under  Affine  transformation. 


•  Partial  matching  helps  to  detect  occluded  objects. 

•  The  Hashing  technique  allows  us  to  do  content  dependent 
matching  efficiently. 

•  Many  operations  in  the  algorithm  can  be  performed 
simultaneously  with  parallel  processing. 

B.  EXPERIENCE  GAINED 

The  experience  gained  in  this  study  can  be  summarized  as 
follows . 

1.  Affine  Invariant 

This  is  the  characteristic  of  Affine  invariant 
matching.  In  experiments,  the  algorithm  can  detect  objects 
under  similarity  transformations.  The  models  existing  in  the 
scene,  can  experience  translation,  rotation,  or  scaling  to 
some  arbitrary  degree.  The  algorithm  is  able  to  recognize  the 
existing  models. 

2.  Partial  Matching 

The  triplets  used  in  this  algorithm  are  essential 
local  features.  In  a  composite  test  scene  objects  can  be 
recognized  in  the  presence  of  occlusion  due  to  the  hidden 
interesting  points  without  any  problem. 

3.  Speed  and  Complexity 

The  computational  complexity  of  this  system  is  highly 
dependent  on  the  number  of  interesting  points  used  after  the 
preprocessing  phase.  The  complexity  of  this  algorithm  grows 
as  m‘' ,  where  m  is  the  number  of  interesting  points.  However, 
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if  effective  classification  of  composite  local  features 
exists,  then  it  can  be  incorporated  in  the  Encoding  procedure 
to  improve  the  system  performance. 

4 .  Noise  Perturbation 

The  established  system  is  very  rigid  in  calculating 
the  hashkey  in  the  Recognition  procedure.  If  part  of  the 
interesting  points  in  the  scene  are  affected  by  noise,  the 
calculated  Affine  coefficient  pairs  based  on  those  affected 
points  will  not  contribute  to  the  evidence  accumulation  of  the 
model  triplet.  This  means  that  the  present  implementation  is 
still  noise  sensitive.  However  if  the  number  of  the 
unaffected  interesting  points  is  in  the  majority,  contribution 
to  the  voting  from  other  unaffected  points  still  allows 
recognition  of  the  test  object. 


C.  RECOMMENDATIONS 

The  main  weakness  in  the  present  implementation  exists  in 
the  data  structure  and  the  decision-making  technique. 

•  The  data  structure  used  in  the  system  is  not  efficiently 
utilized  due  to  the  redundancy  of  the  record  fields  of 
the  data  file,  such  as  the  two  dimensional  vote  array. 
This  is  a  physical  size  problem.  If  there  are  more  than 
14  interesting  points  in  the  scene,  the  system 
implemented  here  cannot  handle  them.  If  more  memory  is 
available  recompilation  of  the  source  code  will  reduce 
the  limitation. 

•  On  the  VERIFY  module,  the  decision-maxing  technique  ur,ed 
is  not  yet  mature.  The  present  method  just  considers  the 
corresponding  edge  distance  between  the  model  and  the 
recognized  model.  If  there  are  scaled  or  enlarged  models 
in  the  test  scene,  the  threshold  used  in  decision-making 
needs  to  be  chang':;a  from  one  scaled  or  enlarged  model  to 


59 


another.  This  needs  improvement  to  obtain  a  flexible 
decision-making  strategy. 

Beside  these  two  problems,  possible  subjects  for  future 
study  related  to  Affine  invariant  matching  could  be: 

•  Find  a  more  effective  local  feature  classification 
technique  in  model  representation.  This  can  help  to 
reduce  the  Hash  table  size  and  reduce  the  computation 
complexity. 

•  Use  the  mean  square  error  method  to  achieve  better  noise 
immunity  for  the  Hash  table  access  in  the  recognition 
phase. 

•  Extend  Affine  invariant  matching  to  handle  3-D  object 
recognition. 

•  Find  some  parallel  hardware  implementation  such  as 
Content  Addressable  Memory  (CAM)  or  others  to  achieve 
parallel  searching  or  matching  of  a  test  object  against 
various  model  points. 
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APPENDIX  A 


PASCAL-LIKE  PSEUDO  CODES 

This  appendix  contains  those  Pascal-like  pseudo  codes  used 
in  the  established  system.  Explanation  of  each  of  the  modules 
is  discussed  in  Chapter  III. 

****************************************************************** 


program  affine ( interest ingdata ,hashkeydata) 

(*  affine  finds  the  affine  coefficient  pairs  *) 
(*  the  input  is  interesting  data  file 
the  output  is  hashkey  data  file  *) 


procedure  matrix_mult ( inverse_matrix  :  array; 

var  difference, coord  :array); 

begin 

for  i  :=  1  to  2  do 
for  j  ;=  1  to  2  do 

coord[i,j]  :=  coord [i,j]  +  inverse_matrix[ i , n] 

*  dif ference[n, j ] ; 


end; 


procedure  inverse (base_matrix  :  array; 

var  inverse_matrix  : array); 

begin 

for  i  :=  1  to  2  do 
for  j  :=  1  to  2  do 

determinent  :=  det  (base_matrix[i, j ] ) ; 
inverse_matrix[ i , j ]  :=  (-l'**(i+j)  *  base_matrix[i, j ] 

/  determinent ; 


end  ; 


procedure  calculate_coord (basex,basey  :  array); 
begin 

for  i  :=  1  to  2  do 
begin 

base_matrix[ i , j ]  :=  basex[i]  -  basex[i+l]; 
base_matrix[i, j ]  ;=  basey[i]  -  basey[i+l]; 
end ; 

inverse (base_matrix, inverse_raatrix) ; 
dif ference [ i , j ]  :=  restbase[i]  -  base[3]; 
matrix_mult ( inverse_matrix,dif ference, coord) ; 
end ; 


procedure  perm(basex,basey  : array; 

k  :  integer) ; 
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begin 

if  k  =  3  then  calculate_coord (basex, basey) ; 
else 

for  i  :=  k  to  3  do 
begin 

tx  : =  basex [ i ] ; 
ty  ;=  basey [i]; 
basex[i]  :=  basex [ k] ; 
basey[i]  :=  basey [k] ; 
basex [k]  :=  tx; 
basex [k]  :=  ty; 
penn(basex, basey, k+1) ; 
end; 
end; 

procedure  collinear (coinbinationx,coitibinationy  :  array)  ; 
begin 

tl  :=  arctan(  (coinbinationx[3]-coinbinationx[2] )  / 
(coinbinationx[2]-coinbinationx[l] ) ) 
t2  :=  arctan(  (combinationy[3]-coinbinationy[2] )  / 
(combinationy[2]-combinationy[l] ) ) 
if  tl  =  t2  then  collinear  :=  true; 
else  perm (basex, basey, 1) 
end; 

procedure  combination (k, index  :  integer); 
begin 

if  index  >  3  then  collinear (comx, corny) 
else 

for  i  :=  k  to  interestingno  do 
begin 

comx [index]  :=  x[i]; 
corny [index]  :=  y[i]; 
combination ( i+1 , index+l) ; 
end; 

end; 

(*  main  affine  *) 
begin 

while  not  eof ( interestingdata)  do 
begin 

readln( interest ingdata,x[i] ,y[i]) ; 
combination(l, 1) ; 
end; 
end; 

****************************************************************** 


program  hash (hashkeydata,hashdata) ; 
(*  hash  generates  the  hash  table  *) 


62 


(*  input  is  hashkey  data  file 
output  is  hash  data  file  *) 


procedure  initialize; 
var  i  ;  integer; 
begin 

for  i  ;=  1  to  tablesize  do 
model [i] .hashkey  :=  empty; 
model [i] . link  :=  empty; 

end; 

procedure  hashing (var  hashkey  :  integer;  inkey  :  integer) ; 

const  multipler  =  100000; 

begin 

inkey  :=  (keyl  +  key 2)  *  multiplier; 
hashkey  :=  (inkey  mod  tablesize) ; 
if  model .hashkey  <>  empty  then 
insert (hashkey) 

else 

collision (hashkey) ; 

end; 

procedure  collision {hashkey  :  integer); 

var  bucket_length  ;  interger; 

begin 

bucket_length  ;=  0; 

while  model [hashkey ]. link  <>  empty  do 
begin 

hashkey  ;=  model [hashkey ]. link; 
bucket_length  :=  bucket_length  +  1; 
end; 

insert (model [hashkey ] )  ; 
model [hashkey ]. link  ;=  bucket_length; 
end; 

(*  main  hash) 
taegin 

while  not  eof (hashkeydata)  do 
begin 

readln (hashkeydata , model . inkey , model . keyl , model . key2 ) : 
initialize ; 

hashing ( 1 , model . inkey) ; 
end. 


program  tally ( interestingdata , cadidatedata , hashdata , plotingdata) ; 


(*  tally  generates  the  recognized  model  interesting  data  point 
in  the  test  object  space  *) 
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{*  the  input  data  files  are 

interetingdata  :  the  original  information  of  the  model, 
candidatedata  :  the  test  triplet,  and 
hashdata  :  the  Hash  table 

the  output  data  file  is 
plotingdata  *) 

procedure  search (modelno  :  integer); 
begin 

while  (model .model id  =  modelno)  and  (modelno  <=  total_modelno)  do 
begin 

for  i;=  1  to  test_interestingno  do 
begin 

cand[ i] .hashkey  :=  cand[i] . inkey  MOD  tablesize; 
if  (cand[ i] . hashkey  =  model .hashkey)  then 
begin 

vote (modelid, tripletid)  :=  vote (modelid, tripletid)  +  1; 
temporary  :=  model; 

(*  Temporary  is  used  to  collect  the  accessed  entry*) 
temporary_table_si2e  :=  temporary_table_size  +1; 
end; 
end; 
end; 

verify (1)  ; 
end; 

procedure  verify (tripletid) ; 
begin 

for  i  ;=  1  to  temporary_table_size  do 
begin 

if  (screen_threshold  <  vote(modelid, tripletid)  then 
begin 

selected_tripletid  :=  tripletid; 
number_selected  :=  number_selected  +1; 
end 
else 

begin 

successful  :=  false; 
end; 

(*  control  goes  back  to  main  program  for  the  2nd  test  triplet  *) 


if  (selected. model id  =  temporary .modelid)  and 

(selected. tripletid  =  temporary . tripletid)  then 
begin 

collected. keyl  :=  temporary [tripletid] . key 1 ; 
collected. key2  :=  temporary[tripletid].key2; 
reconstruct (number_selected, collected. keyl , collected . key 2 , 
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selected_inodel_triplet ,  test_triplet)  ; 

end; 

end; 

end; 

search  (modelno+1) ; 
end; 

procedure  reconstruct (nuinber_selected  :  integer; 

keyl , key2  :  real ; 

selected_inodel_triplet, test_triplet  :  array)  ; 

begin 

(*  perform  the  Affine  transformation  on  the 
selected_model_triplet 

and  the  test_triplet  respectively  to  obtain  the  model 
interesting 

points  and  the  interesting  points  exit  in  the  test  object*) 


for  k  :=  1  to  number_selected  do 
begin 

for  i  :=  1  to  interestingpoint  do 

(x[i],y[i])  :=  affine  (keyl,key2,selected_model_triplet) ; 

for  j  :=  1  to  interestingpoint  do 

(x[j],y[j])  :=  affine  (keyl , key2 , test_triplet) ; 

(*  find  the  order  corresponding  relationship  between  (x[i],y[i]) 

and  (x[j],y[jj)  to  obtain  ordered(x[i] ,y[i] )  *) 

(*  perform  the  square  error  between  the  ordered (x [ i ], y [ i ] ) 
and  the  test  object  interesting  coordinate  *) 

if  (moael_triplet [k] . square_error  <  square_error_threshold) 

and 

(model_triplet [k] .square_error  <=  minimun_square_error) 

then 

begin 

optimum_triplet  :=  k; 

minimun_square_error  :=  model_triplet [k] . square_error ; 
end 

else 

begin 

verify (tripletid) ; 
end; 

display (optimum_model_triplet) ; 

(*  the  control  goes  back  to  the  search  for  the  rest  of  models  *) 
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(*  raain  tally  *) 
begin 

readln  ( interestingdata,  total_inodelno,  interestingno)  ; 
while  not  eof (hashdata)  do 

readln  (hashdata , model . hashkey , model . inkey , model . key 1 , model • key 2 , 

model .model id, model .triplet id, model_triplet) ; 
while  not  eof (candidatedata)  do 
begin 
readln 

( candidatedata , cand . inkey , cand . key 1 , cand . key2 , test_tr iplet ) ; 
search (1) ; 


APPENDIX  B 


LISTING  OF  SOURCE  CODES 

program  gen (interesting) ; 
type  ary  =  array  [1.. 2,1.. 50]  of  integer; 
var  i,j ,modelno, interest ingno  :  integer; 
interesting  :  text; 
x,y  :  ary; 
begin 

open ( interesting, ' interesting.dat’ , history  :=  new) ; 
rewrite (interesting) ; 
l**************inodel  1  ************} 
modelno  :=  1;  interest ingno  :=  7; 


x[l,l] 

:=  20; 

x[l,2] 

:=  30; 

x[l,3] 

:=  40; 

x[l,4] 

:=  50; 

X[l,5] 

:=  40; 

x[l,6] 

:=  30; 

x[l,7] 

:=  30; 

y[i,i] 

:=  30; 

y[i,2] 

:=  40; 

y[l,3] 

:=  30; 

y[l,4] 

:=  20; 

y[i/5] 

:=  10; 

y[i,6] 

:=  10; 

y[l,7] 

:=  20; 

writeln ( interesting, modelno, interestingno) ; 
for  i  ;=  1  to  interestingno  do 
writeln ( interesting ,x[l,i],y[l,i]) ; 

( **************inodel  2  ************} 


modelno 

:=  2; 

interestingno 

;=  5; 

x[2,l] 

x[2,5] 

=  40; 
=  30; 

x[2,2]  :=  40; 

X[2,3] 

:=  35;  x[2,4] 

:=  30; 

y[2,i] 

y[2,5] 

=  35; 
=  35; 

y[2,2]  :=  20; 

y[2,3] 

:=  20;  y[2,4] 

:=  15; 

writein(interesting, modelno, interestingno) ; 
for  i  :=  1  to  interestingno  do 
writeln ( interesting ,x[2,i],y[2,i]) ; 

close ( interesting) ; 
end. 


program  preproc( interesting, coordinate) ; 
const  total  =  9999; {user  supply) 
type  ary  =  array  [1.. total]  of  integer; 
aryl  =  array  [1..2,1..2]  of  real; 
ary2  =  array  [1..3]  of  integer; 
ary3  =  array  [1..2,1..1]  of  real; 
ary4  =  array  [1..2,1..2]  of  integer; 
var  count, i,j ,k, index  :  integer; 

outmodelno, out interest ingno  :  array  [1..10]  of  integer; 
modelno, tripletno, interestingno, table_size  :  integer; 

X, y , rest_basex, rest_basey  :  ary; 
inverse_matrix  :  aryl ; 
basex,basey,comx, corny  :  ary2; 
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diff, coord  :  ary3 ; 
base_inatrix  :  ary4 ; 
interesting, coordinate  :  text; 


procedure  inatrix_mult ( inverse_inatrix  ;  aryl; 

var  diff, coord  :  ary3) ; 

const  k  =  2 ; 

1  =  2; 


m  =  1 ; 

var  i,il,n  :  integer; 
begin 

for  i  :=  1  to  1  do 
for  il  :=  1  to  m  do 
coord [i,il]  :=  0; 
for  i  ;=  1  to  1  do 
for  il  :=  1  to  m  do 
for  n  ;=  1  to  1  do 

coord  [i,il]  :=  coord  [i,il]  +  inverse_inatrix[i,n] 
diff [n, il] ; 

end; 


procedure  inverse  (base_inatrix  :  ary4 ; 

var  inverse_inatrix  :  aryl)  ; 
var  det  :  real; 

begin 

for  i  :=  1  to  2  do 

det  :=  (base_inatrix[  1 , 1  ]  *  base_inatrix[2, 2] )  - 
(base_Tnatrix[l,2]  *  base_inatrix[2 , 1] )  ; 
inverse_inatrix[l,  1]  ;=  base_inatrix[ 2 , 2  ]/det ; 
inverse_inatrix[l,2]  base_inatrix[  1 , 2  ]  *  (-1)  /det; 
inverse_inatrix[2, 1]  :=  base_XQatrix[ 2 , 1]  *  (-1)  /det; 
inverse_inatrix[2,2]  ;=  base_inatrix [  1 , 1]  /det; 
end; 


procedure  calculate_coord(basex,basey  :  ary2) ; 

var  i,m,il,i2,i3  :  integer; 

begin 

for  i  :=  1  to  2  do 
begin 

base_inatrix[l ,  i]  :=  basex[i]  -  basex[i+l]; 
base_inatrix[2 ,  i]  :=  basey[i]  -  basey[i+l]; 
end; 

inverse  (base_inatrix,  inverse_inatrix)  ; 
i2  ;=  1; 

for  i  :=  1  to  interestingno  do 
{i  is  the  number  of  basis  triplets) 
begin 

if  ((basex[l]  <>  x[i])  or  (basey[l]  <>  y[i]))  and 
((basex[2]  <>  x[i])  or  (basey[2]  <>  y[i]))  and 
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((basex[3]  <>  x[i])  or  (basey[3]  <>  y[i]))  then 
begin 

rest_basex[i2]  :=  x[i]; 
rest_basey [i2]  :=  y[i]; 
i2  :=  i2  +  1; 
end; 
end; 

for  i  ;=  1  to  (interestingno-3)  do 
begin 

diff[l,l]  :=  rest_basex[i]  -  basex[3]; 
diff[2,l]  :=  rest_basey[i]  -  basey[3]; 
matr ix_inult  ( inver se_matr ix ,  di f  f ,  coord)  ; 
count  :=  count  +1; 

i3  :=  count  mod  (interestingno-3) ; 
if  i3  =  1  then  tripletno  ;=  tripletno  +  1; 

write ( coordinate , modelno , tripletno , coord [1,1], coord [2,1]) ; 

for  il  :=  1  to  3  do 

write (coordinate, basex[il] ,basey[il] ) ; 

writeln (coordinate) ; 

end; 

end; 

procedure  perm(basex,basey  :  ary2 ; 

k  :  integer) ; 
var  i,tx,ty  ;  integer; 
begin 

if  k  =  3  then 

calculate_coord (basex , basey ) 
else 

for  i  :=  k  to  3  do 
begin 

tx  :=  basex[i] ; 
ty  ;=  basey [i] ; 
basex[i]  :=  basex [ k] ; 
basey [i]  :=  basey[k] ; 
basex [k]  :=  tx; 
basey [k]  :=  ty; 
perm (basex, basey , k+1) ; 
end; 

end; 

procedure  colinear(comx, corny  :  ary 2) ; 

var  colinearxl,colinearx2 ,colinearyl,colineary2  :  integer; 

tl,t2  :  real; 
begin 

colinearxl  ;=  comx[2]  -  comx[l]; 

colinearx2  :=  comx[3]  -  comx[2]; 

colinearyl  :=  corny [2]  -  comy[l]; 

colineary 2  :=  corny [3]  -  corny [2]; 

if  (colinearxl  <>  0)  then 
tl  :=  arctan (colinearyl  /  colinearxl) 
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else  tl  :=  1.5707; 
if  (colinearx2  <>  0)  then 
t2  :=  arctan (colineary 2  /  colinearx2) 
else  t2  :=  1.5707; 
if  tl  <>  t2  then  penti(coinx,coiny,  1)  ; 
end; 

procedure  comb (k, index  :  integer) ; {use  the  recursive} 

var  i  :  integer; 

begin 

if  index  >  3  then  colinear(comx, corny) 
else 

for  i  :=  k  to  interestingno  do 
begin 

comx[ index]  :=  x[i]; 
corny [index]  :=  y[i]; 
comb  ^+1,  index+l)  ; 
end; 

end; 

begin{main} 

open ( interesting, ' interesting.dat history  :=  old) ; 
reset (interesting) ; 

open (coordinate, 'coordinate.dat' , history  :=  new) ; 
rewrite (coordinate) ; 
table_size  ;=  0;j:=  1; 
while  not  eof (interesting)  do 
begin 

readln ( interesting , outmodelno [ j ] , out interest ingno [ j ] ) ; 
modelno  :=  outmodelno[ j ] ; 
interestingno  :=  outinterestingno[ j ] ; 
for  i  :=  1  to  interestingno  do 
readln ( interesting ,x[i],y[i]) ; 
count  : =0 ; tripletno  :=  0;j  :=  j+1; 
comb (1,1)  ; 

table_size  :=  table_size  +  count; 
end; 

writeln ( coordinate , table_size , outmodelno [ 1 ] , outinterestingno [ 1 ] , 

outmodelno [ 2 ] , outinterestingno [ 2 ] ) ; 
close (interesting) ; 
close (coordinate)  ; 
end. 

***************************************************************** 


program  keycon (inf ile, outf ile) ; 
type 

inrec  =  record 

modelno, tripletno  :  integer; 
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keyl,key2  :  real; 

basexl,baseyl,basex2 ,basey2,basex3 ,basey3  :  integer 
end; 

outrec  =  record 
outkey  :  integer ; 

basexl,baseyl,basex2,basey2,basex3 ,basey3  :  integer 
end; 

aryl  =  array  [0.. 99999]  of  integer; 

var 

a  :  array [ 0. . 99999]  of  outrec; 
b  :  inrec ; 

infile, outfile  :  text; 
temp  :  real ; 
i ,  ,  j  1  :  integer ; 

outmodelno, outinterestingno  :  array  [1..50]  of  integer; 
table_size, ary  :  aryl; 

procedure  prime (var  primeno  :  integer); 
var 

is  :  boolean; 
i,j,k,c  :  integer; 
begin 

ary[l]  ;=  2; 
c :  =  1 ; 

for  i  ;=  3  to  primeno  do 
begin 
j  :=  l; 
is  :=  false; 
repeat 

if  (i  mod  ary[j])  -0  then 
is  ;=  true; 
j:=  j+l; 

until  (ary[j]  =0)  or  (ary[j]  >  sqrt(i))  or  is; 
if  not  is  then 
begin 
c  :  =  c+ 1 ; 
ary[c]  :=i; 
end; 
end; 

is:=false; 
while  not  is  do 
begin 

for  k  :=  1  to  j  do 
if (primeno  mod  ary[k])  =  0  then 
is  :=  true; 
primeno  ;=  primeno+1; 
end; 
end; 

begin 

open  (infile, 'coordinate.dat' ,history:=old) ; 
reset ( infile) ; 


open  (out file, 'hash_key.dat' , history :=new) ; 
rewrite (outfile) ; 
j  :  =0  ; 

while  not  eof( infile)  do 
begin 

readln(infile, table_size[ j ] ) ; 

j  :=  j+i; 

end ; 

close ( inf ile)  ; 

open  (infile, 'coordinate.dat' ,history:=old) ; 
reset (infile) ; 
jl  :=l; 

while  not  eof( infile)  do 
begin 

if  jl  -  table_size[ j-l]+l  then 
begin 

readln  ( infile ,  table_size  [  j  -1  ]  ,  outmodelno  [  1  ]  ,  outinter#»stingno  [  1  ]  , 
outmodelno [ 2 ] , outinterestingno [ 2 ] ) ; 

end 

else 

readln ( inf ile) ; 
jl  ;=  jl+1; 
end; 

prime (table_size[j-l] ) ; 
write(outfile, table_size[ j-l] ) ; 

write(outfile,outmodelno[l] ,outinterestingno[l] , 
outmodelno [ 2 ] , outinterestingno [21); 
writeln (outfile) ; 
close (inf ile) ; 

open  (infile, 'coordinate.dat ' ,history:=old) ; 
reset (inf ile) ; 

i  :  =  0  ; 

while  i  <>  j-l  do 
with  b  do 
begin 

readln ( infile , modelno, tripletno , keyl , key 2 , 

basexl , baseyl , basex2 , basey2 , basex3 , base/B ) ; 
temp  ;=  (keyl+key2) *10000000 ; 
a[i].outkey  :=  trunc  (temp); 
writeln (outfile, a [ i] . outkey, modelno, 

tripletno, keyl , key2 , basexl , baseyl , basex2 , 
basey2 ,basex3 ,basey3) ; 
i  :=  i+i 

end; 

close ( infile) ; 
close (outfile)  ; 
end. 


***************************************************************** 


program  hashing (input, output ) ; 
const  database_modelno  =  2 ; 
type 

rec  =  record 

inkey,modelno, tripletno, link  :  integer; 
keyl,key2  :  real; 

basexl,baseyl,basex2,basey2,basex3,basey3  ;  integer; 
end; 

outrec  =  record 

hashkey, inkey ,modelno, tripletno, link  ;  integer; 
keyl,key2  :  real; 

basexl,baseyl,basex2,basey2,basex3,basey3  :  integer; 
end; 

var  a  :  array[0. .99999]  of  outrec; 
b :  rec ; 

i , j , k, table_size  ;  integer; 

outmodelno, out interest ingno  :  array  [ 1 . . database_modelno ] 

of  integer; 

procedure  print; 
var  il  :  integer; 
begin 

for  il  :=  0  to  table_size  do 
begin 

if  a[ il] .hashkey  <>  -1  then 
with  a[il]  do 

wr iteln ( output , hashkey , inkey , modelno : 2 , 
tripletno : 4 , keyl , key2 , basexl : 4 , 

baseyl : 4 , basex2 : 4 ,basey2 ; 4 , basex3 : 4 , basey3 ; 4 , link ) 


end 

end ; 

procedure  solve_collision (var  i,j  ;  integer); 

(if  the  hash  key  is  same  then  find  the  last  same  hash  key  of  the 
linked  chain  thru  the  link) 
begin 

while  a[i].link  <>  -1  do 
begin 

i  ; =  a [ i ] . link 

end ; 

{test  the  last  hash  ]:ey  of  the  linked  chain  if  its  next  position 
points  to  the  free  entry,  till  find  the  free  space 
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i  :  means  the  previous  linked  same  hash  key 

j  :  means  the  one  which  is  free  entry,  it  also  link  to  pi.evious 


same  key} 
j  :=  i; 

while  a[j].hashkey  <>  -1  do 
begin 

j  :=  j+1? 

if  j  >  table_size  then  j  :=  0 
end; {while) 
end; 

procedure  initialize; 
var  il,i2  :  integer; 
begin 

for  il  :=  0  to  table_size  do 
with  a[il]  do 

a[il] .hashkey  :=-l; 
for  i2  :=  0  to  table_size  do 
with  a[i2]  do 

a[i2] .link  :=-l; 

end; 

procedure  insert (var  i , j : integer) ; 
begin 

if  (a[i] .hashkey  =  -1)  then 
begin 

a[i]. hashkey  :=i; 
a [i]. inkey  :=  b. inkey; 
a[i].modelno  :=  b.modelno; 
a[i] .tripletno  :*  b.tripletno; 
a[i].keyl  ;=  b.keyl; 
a [i]. key 2  :=  b.l:ey2; 
a[i].basexl  ;=  b.basexl; 
a[i].baseyl  ;=  b.baseyl; 
a[i].basex2  ;=  b.basex2; 
a[i].basey2  :=  b.basey2; 
a[i].basex3  ;=  b.basex3; 
a[i].basey3  :=  b.basey3; 
end 
else 

begin 

solve_collision(i,  j)  ; 

if  (a[i] .modelno  <>  a[ j ] .modelno)  and 

(a[ i] .tripletno  <>  a[ j ] .tripletno)  then 
begin 

a[i] .link  ;=  j ; 

a[ j ] .hashkey  :=  j ; 

a[j]. inkey  :=  b. inkey; 

a[j]. modelno  :=  b.modelno; 

a [ j ]. tripletno  ;=  b.tripletno; 

a[j].keyl  :=  b.keyl; 
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end 


end 


a[j].key2  :=  b.key2; 
a[j].basexl  :=  b.basexl; 
a[j].baseyl  :=  b.baseyl; 
a[j].basex2  :=  b.basex2; 
a[j].basey2  b.basey2; 
a[j].basex3  :=  b.basex3; 
a[j].basey3  :=  b.basey3; 


end; 

begin  (*  main  *) 

open  (input, 'hash_key.dat' , history  :=  old); 
reset (input) ; 

open  (output, 'hash.dat history  :=  new); 
rewrite (output) ; 

readln ( input , table_size , outmodelno [ 1 ] , outinterestingno [ 1 ] 
, outmodelno [ 2 ] , outinterestingno [ 2 ] ) ; 
writeln ( output , table_size , outmodelno [ 1 ] , outinterestingno 
[ 1 ] , outmodelno [ 2 ] , outinterestingno [ 2 ] ) ; 
initialize ; 
i  :=0;j  ;=  0; 
while  not  eof( inpur)  do 
begin 
with  b  do 
begin 

read (input, inkey) ; 

read ( input , modelno , tr ipletno , key 1 , key2 , 
basexl , basey 1 , basex2 , basey2 , basex3 , basey 3 ) ; 
readln; 

i  ;=  b. inkey  mod  table_size; 

insert ( i , j ) ; 

end 

end  (*while*); 
print ; 

close ( input)  ; 
close (output) 
end. 


’k’k’kic'k'k'k'k’kic'kic'kit'k'kitific'kicic’kic'k'kic'k'kic'k'k'kicic'k'k'kicit'k'kicit’k'k'kic'k’kiiicic'k'k'k’kicicick’kitie'k 


program  test_gen ( interesting) ; 

type  ary  =  array  [1.. 2,1.. 50]  of  integer; 
var  i,j , modelno, interest ingno  ;  integer; 
interesting  :  text; 
x,y  :  ary; 
begin 

open(interesting, ' tally_interesting.dat ', history  ;=  new) ; 
rewrite ( interesting) ; 

{******************* test  object********************* ) 
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inodelno:=l;interestingno  :=  10; 

x[l,l]  ;=  50;  x[l,2]  :=  40;  x[l,3]  :=  30; 

x[l,4]  :=  10;  x[l,5]  :=  10; 

x[l,6]  :=  20;  x[l,7]  :=  30;  x[l,8]  :=  30;  x[l,9]  :=  40; 
:<[1,10]  :=  40; 

y[l,l]  :=  10;  y[l,2]  :=  0;  y[l,3]  :=  10; 
y[l,4]  ;=  10;  y[l,5]  :=  40; 

y[l,6]  :=  40;  y[l,7]  ;=  50;  y[l,8]  :=  30;  y[l,9]  :=  30; 
y[l,10]  :=20; 

writeln (interesting, modelno, interest ingno) ; 
for  i  :=  1  to  interestingno  do 
writeln ( interesting, x[ 1 ,i] ,y[l,i]) ; 

( *******************alternative  data  set**********************} 
(  y[l:l]  :=  90;  y[l,2]  :=  70;  y[l,3]  :=  50;  y[l,4]  :=  30; 
y[l,5]  :=  40;  y[l,6]  :=  30;  y[l,7]  :=  50;  y[l,8]  :=  70; 
y[l,9]  :=  90;  y[l,10]  :=  90;  y[l,ll]  :=  70;  y[l,12]  :=  50; 
y[l,13]  :=  70;  y[l,14]  :=  90; 
writeln(interesting, modelno, interestingno) ; 
for  i  :=  1  to  14  do 
writeln ( interesting ,x[l,i] ,y[l,i]) ; 

) 

close (interesting) ; 
end. 


program  test_preproc ( interesting, coordinate) ; 
const  total  =  9999; (user  supply} 
type  ary  =  array  [l.. total]  of  integer; 
aryl  =  array  [1..2,1..2]  of  real; 
ary2  =  array  [1..3]  of  integer; 
ary3  =  array  [1..2,1..1]  of  real; 
ary4  =  array  [1..2,1..2]  of  integer; 
var  count, i,k, index  :  integer; 

modelno, interestingno, table_size  :  integer; 

x,y , rest_basex, rest_basey  :  ary; 

inverse_matrix  ;  aryl; 

basex,basey,comx, corny  ;  ary2; 

diff, coord  ;  ary3 ; 

base_matrix  :  ary4 ; 

interesting, coordinate  ;  text; 

procedure  test_ma ':rix_mult ( inverse_matrix  :  aryl; 

var  diff, coord  :  ary3) ; 

const  k  =  2 ; 

1  =  2; 
m  =  1 ; 

var  i,j,n  :  integer; 
begin 

for  i  :=  1  to  1  do 
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for  j  :=  1  to  m  do 
coord [ i , j ]  : =  0 ; 
for  i  ;=  1  to  1  do 
for  j  :=  1  to  m  do 
for  n  :=  1  to  1  do 
coord [i, 3 ]  :=  coord [i,j] 
diff [n, j]  ; 


end; 


+  inverse_inatrix[ i ,  n] 


* 


procedure  test_inverse  (base_inatrix  :  ary4 ; 

var  inverse_inatrix  :  aryl)  ; 
var  det  :  real; 


begin 

for  i  ;=  1  to  2  do 

det  :=  (base_inatrix 
(base_inatrix[  1 , 
inverse_inatr  ix  [1,1] 
inverse_inatrix  [1,2] 
inverse_inatr  ix  [2,1] 
inverse_matr ix [2,2] 
end; 


1,1]  *  base_inatrix  [2,2])  - 
]  *  base_inatrix[2 , 1] )  ; 

:=  base_inatrix[  2 , 2  ]/det ; 

:=  base_inatrix[  1 , 2  ]  *  (-1) 
:=  base_inatrix[2 , 1]  *  (-1) 
:=  base_inatrix[  1, 1]  /det; 


/det ; 
/det  ; 


procedure  test_calculate_coord (basex, basey  :  ary2) ; 

var  i,j,il,i2  :  integer; 

begin 

for  i  :=  1  to  2  do 
begin 

base_inatrix[l,  i]  :=  basex[i]  -  basex [i+1]; 
base_inatrix[2  ,  i]  :=  basey  [i]  -  basey  [i+1]; 
end; 

test_inverse  (base_inatrix,  inverse_inatrix)  ; 
i2  :=  1; 

for  i  :=  1  to  interestingno  do 
{this  i  is  the  number  of  basis  triplet) 
begin 

if  ({basex[l]  <>  x[i])  or  (basey[l]  <>  y[i]))  and 
((basex[2]  <>  x[i])  or  (basey[2]  <>  y[i]))  and 
((basex[3]  <>  x[i])  or  (basey[3]  <>  y[i]))  then 
begin 

rest_basex[ i2 ]  ;=  x[i]; 
rest_basey [ i2 ]  :=  y[i]; 
i2  :=  i2  +1; 
end; 

end; 

for  i  :=  1  to  interestingno-3  do 
begin 

diff [1,1]  :=  rest_basex[ i]  -  basex[3]; 
diff [2,1]  :=  rest_basey [ i ]  -  basey[3]; 
test_inatrix_mult ( inverse_roatrix, diff , coord)  ; 
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count  :=  count  +1; 

write ( coordinate , modelno , count , coord [1,1] , coord [2,1]) ; 
for  il  :=  1  to  3  do 

write ( coordinate, basex[il] ,basey[il] ) ; 

writeln (coordinate) ; 

end; 

end; 

procedure  test_perin(basex,basey  :  ary2 ; 

k  ;  integer) ; 
var  i,tx,ty  :  integer; 
begin 

if  k  =  3  then 

test_calculate_coord (basex,basey) 
else 

for  i  :=  k  to  3  do 
begin 

tx  :=  basex[ i] ; 
ty  :=  basey [ i] ; 
basex[i]  :=  basex[k] ; 
basey[i]  :=  basey[k] ; 
basex[k]  :=  tx; 
basey [k]  :=  ty; 
test_penn(basex, basey, k+1) ; 
end; 

end; 

procedure  test_colinear (comx, corny  ;  ary2); 

var  colinearxl,colinearx2,colinearyl,colineary2  :  integer; 

tl,t2  :  real; 
begin 

colinearxl  ;=  comx[2]  -  corox[l]; 

colinearx2  ;=  coinx[3]  -  coinx[2]; 

colinearyl  :=  corny [2]  -  corny [1]; 

colineary2  :=  comy[3]  -  coroy[2]; 

if  (colinearxl  <>  0)  then 
tl  :=  arctan (colinearyl  /  colinearxl) 
else  tl  :=  1.5707; 
if  (colinearx2  <>  0)  then 
t2  :=  arctan (colineary2  /  colinearx2) 
else  t2  :=  1.5707; 

if  tl  <>  t2  then  test_penn (comx, corny , 1) ; 
end ; 

procedure  comb (k, index  :  integer) ; (use  the  recursive) 

var  i  :  integer; 

begin 

if  index  >  3  then  test_colinear(comx, corny) 
else 

for  i  :=  k  to  interest ingno  do 
begin 
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coinx[ index]  :=  x[i]; 
corny [index]  :=  y[i]; 
coinb(i+l,  index+1)  ; 
end; 

end; 

begin {main} 

open ( interesting, 'tally_interestin9. dat' , history  ;=  old) ; 
reset (interesting) ; 

open (coordinate, 'tally_coordinate.dat history  :=  new); 
rewrite (coordinate) ; 
table_size  :=  0; 
while  not  eof (interesting)  do 
begin 

readln( interesting, modelno, interestingno) ; 
writeln(coordinate, interestingno) ; 
for  i  :=  1  to  interestingno  do 
readln ( interesting , x [ i ] , y [ i ] ) ; 
count  :=0; 
comb (1,1)  ; 

table_size  :=  table_size  +  count; 
end; 

close ( interesting) ; 
close (coordinate) ; 
end. 


program  test_lceycon(infile,outfile)  ; 
type 

inrec  =  record 

modelno, tripletno  :  integer; 
lceyl,}cey2  ;  real; 

basexl,baseyl,basex2,basey2,basex3,basey3  :  integer 
end; 

outrec  =  record 
outlcey  :  integer; 

basexl,baseyl,basex2,basey2,basex3,basey3  :  integer 
end; 

var 

a  :  array [0. .99999]  of  outrec; 
b  :  inrec ; 

inf ile, outf ile  ;  text; 
temp  :  real ; 

i ,  j  ,  j..  '.erestingno  ;  integer; 
table_s.  Ize  ;  array [0.  .99999]  of  integer; 
begin 

open  (infile, 'tally_coordinate.dat' , history :=old) ; 
reset (infile) ; 

open  (outfile, 'tally.dat' , history :=new) ; 
rewrite (outf ile) ; 


j  :  =0  ; 

i  :=  0; 

readln (infile, interestingno) ; 
writeln (outf ile, interestingno) ; 
while  not  eof( infile)  do 
with  b  do 
begin 

readln ( inf ile,modelno, tripletno, keyl , key2 , 

basexl , baseyl , basex2 , basey2 , basex3 , basey3 ) ; 
temp  :=  (keyl+key2) *10000000 ; 
a[i].outkey  :=  trunc  (temp); 
writeln(outfile,a[i] .outkey,keyl,key2 , 
basexl , baseyl , basex2 , basey2 , basex3 , basey3 ) ; 
i  ;=  i+1 

end; 

close (infile) ; 
close (outf ile)  ; 
end. 


program  tally (input, candfile, output) ; 
const  database_modelno  =2; 
type  candrec  =  record 
inkey  :  integer ; 
keyl,key2  ;  real; 

basexl, baseyl,basex2,basey2,basex3,basey3  ;  integer; 
end; 

outrec  =  record 
hashkey, inkey  ;  integer; 
keyl, key 2  :  real; 

basexl, baseyl, basex2,basey2,basex3,basey3  :  integer; 
end; 

modelrec  =  record 

hashkey, inkey, modelno, tripletno, link  ;  integer; 
keyl,key2  :  real; 

basexl, baseyl,basex2,basey2,basex3,basey3  :  integer; 
end; 

collected_modelrec  =  record 

hashkey, inkey, modelno, tripletno, link  :  integer; 
keyl,key2  :  real; 

basexl, basey 1, basex2 ,basey2, basexl ,basey3  :  integer; 

votel  :  integer; 

end; 

var  initimodell, temporary _model, temp  :  array [0. .9999]  of 

modelrec; 

model  ;  array  [0.. 23000]  of  modelrec; 
collected_model  :  array[l. .9999]  of  collected_modelrec ; 
cand:  array [ 0. . 19999]  of  candrec; 

candl  :  array  [ 1 . . 9999 , 1 . . 2 ]  of  candrec; 
i / j » j 1 » kl , key ,m, index, count  :  integer; 
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n,inaxiinunl,maximun2  :  integer; 
table_si2e, interest ingno,test_interestingno_3  :  integer; 
candfile  ;  text; 

vote  :  array  [0 ..  database_Tnodelno,  0 ..  27999  ]  of  integer; 
outmodelno, outinterestingno  ;  array  [ 1 . . database_modelno] 

of  integer; 


procedure  initialize!; 
var  i,j  :  integer; 
begin 

for  i  :=  0  to  database_inodelno  do 
for  j  :=  0  to  table_size  do 
vote [ i , j ]  : =  0 ; 
end; 

procedure  initialize2; 
var  i  :  integer ; 
begin 

for  i  :=  0  to  table_size  do 
with  model [i]  do 

hashkey  :=  -1; 

end; 

procedure  initialize! (m  ;  integer); 

var  i  :  integer; 

begin 

for  i  :=  1  to  m  do 

with  temporary _roodel [ i]  do 
temporary_model [ i ]  :=  initimodell [ i] ; 

end; 


procedure  print_model_triplet (i  ; integer); 

(*  store  the  information  of  the  selected  triplet  *) 
begin 

with  collected_model [ i]  do 

writeln (output , hashkey , inkey, modelno: 2 , tripletno; 4 , 
keyl , key2 , basexl : 4 , basey 1 ; 4 , basex2 : 4 , basey2 : 4 , 
basex3 : 4 , basey! : 4 , votel ) ; 

end; 


procedure  print_test_triplet (i , k  :  integer) ; 

(*  store  the  information  of  the  test  triplet  *) 

(*  i  is  the  corresponding  between  select  model  triplet  and  test 

triplet  *) 
begin 


with  candl[i,k]  do 


writeln (output, '  10, inkey, •  ' :6,keyl,key2,basexl:4, 

basey 1 : 4 , basex2 : 4 , basey2 : 4 , basex3 : 4 , basey 3 : 4 ) ; 

end; 


procedure  all_maxiinun_selected  (n  :  integer)  ; 

(*  store  all  the  selected  model  triplets  even  from  different 
model  *) 

var  i,j,cout  :  integer; 
begin 

for  i  :=  1  to  n  do 
begin 

with  collected_model [ i]  do 

if  ( (modelno  =  1)  and  (votel  =  maximunl)) 
or 

((modelno  =  2)  and  (votel  =  maximun2)) 

then 

begin 

print_model_triplet ( i) ; 

print_test_triplet ( i , 1 ) ; 
end ; 

end ; 

end; 


procedure  verify(j , jl,m  :  integer;var  n  :  integer); 

(*  collect  all  the  accessed  model  *) 

(*  n  is  index  value  of  all  selected  model  *) 

var  i,k,kl,l  :  integer; 
begin 

kl  :=  1; 

for  i  :=  1  to  m  do 

with  temporary_model [ i ]  do 

if  (modelno  =  temporary_model[jl] .modelno)  and 

(tripletno  =  temporary_model[ jl] .tripletno)  then 
begin 

collected_model [n] .hashkey  :=  temporary_model [ i] .hashkey ; 
col lected_model [ n ] . inkey  : =  temporary _model [ i ] . inkey ; 
col lected_model [n] .modelno  :=  temporary_model[i] .modelno; 
collected_model [n] .tripletno  ;=  temporary_model[ i] . 

tripletno ; 

collected_model [n] .keyl  :=  temporary_model[i] .keyl; 
col lected_model [ n ] . key2  ; =  temporary_model [ i ] . key 2 ; 
collected_model [n] .basexl  :=  temporary_model[i] .basexl; 
collected_model [n] . baseyl  ;=  temporary _model [ i] .basey 1 ; 
collected_model [n] .basex2  :=  temporary _model [ i] .basex2 ; 
collected_model [n] .basey2  :=  temporary_model [ i] .basey2 ; 
collected_model [n] .basex3  :=  temporary_model [ i ] .basex3 ; 
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collected_inodel  [n]  .basey3  :=  teinporary_inodel  [i]  .basey3  ; 
collected_inodel  [n] .  votel  :  = 

vote[teinporary_inodel  [i]  .modelno,  temporary _r[iodel[i] . 
tripletno] ; 

for  k  :=  (j  -  test_interestingno_3)  to  j-1  do 

if  (cand[k] . inkey  =  temporary _model [ i] . inkey)  and 
(cand[k] .keyl  =  temporary_model [i] .keyl)  and 
(cand[ki .key2  =  temporary _model [i] .key2)  then 
begin 

candl[n,l]  :=  cand[k]; 

kl  :=  kl  +  1; 
end; 

n  ;=  n+1; 
end; 

initiali2e3 (m) ; 
end; 


procedure  f  ind_maxiinun  (m,  j  :  integer;var  jl  :  integer); 

(*  jl  is  the  selected  model  triplet  index  value  *) 
var  i  :  integer; 

maximun  :  integer; 
begin 

maximun  :=0; 
for  i  :=  1  to  m  do 
begin 

if  (vote [temporary _model [ i] .modelno, temporary _model [ i ] . 

tripletno]  >  maximun)  then 
begin 
jl  :=i; 
maximun  := 

vote[temporary_model [ i] .modelno, temporary _model [i] . 
tripletno] ; 

(*  here  the  1  and  2  as  the  all  different  models  in  database  *) 
(*  each  model  has  it's  own  maximun  vote  *) 

if  (temporary_model [ i] .modelno  =  1)  and 
(maximun  >  maximunl) 
then  maximunl  :=  maximun; 
if  (temporary _model [ i] .modelno  =  2)  and 
(maximun  >  maximun2) 
then  maximun2  :=  maximun; 

end ; 
end ; 

end; 


procedure  search (j ,key: integer; var  m  :  integer); 
(*  m  is  the  length  of  kth  hash  key  bucket  *) 
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var  i,i2  :  integer; 
begin 

i  : =  key ; 

while  (i  <>  -1)  do 
begin 

if  (cand[ j ]. inkey  =  model [ i] . inkey)  and 
(cand[ j ] .keyl  =  model [i] .key 1)  and 
(cand[ j ] .key2  =  model [i] .key 2)  then 
begin 

temporary_model [m]  :=  model[i]; 
with  temporary_model [m]  do 
vote[modelno, tripletno]  ;=  vote [modelno, 

tripletno]+l ; 


m  :=  m  +1; 
end; 

i  :=  model [ i] . link; 
end ; 

end; 

begin  (*  main  *) 

open  ( input hash. dat history  :=  old); 
reset (input) ; 

open  (candfile, 'tally.dat history  :=  old); 
reset (candfile) ; 

open  (output, 'vote.dat history  :=  new); 
rewrite (output) ; 

readln ( input , table_size , outmodelno [ 1 ] , outinterestingno [ 1 ] 

, outmodelno [ 2 ] , outinterestingno [ 2 ] ) ; 
readln(candf ile, interestingno) ; 
test_interestingno_3  ;=  interestingno  -  3; 
initialize! ; initialize2 ; 
i  ;=0;j  ;=  0; 

while  (i  <  table_size)  and  (not  eof( input))  do 
begin 

with  temp[i]  do 
begin 

readln ( input , hashkey , inkey , modelno , tripletno , 
keyl , key2 , 

basexl , baseyl , basex2 ,basey2 ,basex3 ,basey3 , link)  ; 
end ; 

index  :=  temp [ i] .hashkey ; 
model [index]  :=  temp[i]; 
end;  (*while*) 
m  : =  1 ; j 1  ; =1 ; n  : =  1 ; 

(*  *********************CANDIDATE  FILE*****************) 
while  not  eof (candfile)  do 
begin 

with  cand[j]  do 
begin 
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readln ( candf ile , inkey , key 1 , key2 , basexl , basey 1 , 
basex2 ,basey2 ,basex3 ,basey3) ; 

end; 

key  :=  cand[ j ]. inkey  mod  table_size; 
search (j ,key,m) ; 

j  :=  j+i; 

count  :=  j  mod  test_interestingno_3 ; 
if  count  =  0  then 
begin 

f ind_maximun (m, j , j 1) ; 
verify (j ,jl,m,n) ; 
m  :  =  1 ; 
initialize! ; 
end; 
end  ; 

all_maximun_selected (n) ; 

(**************** *****V0TEING  RESULT********************) 
close (input) ; 
close (candf ile) , 
close (output) 
end. 


program  reconstruct (interesting,vote,ploting) ; 

const  totalmodeli.o  =  2  ; 

type 

aryl  =  array  [1..10]  of  integer; 
ary2  =  array  [1..999]  of  integer; 
ary3  =  array  [1..99]  of  real; 
ary4  =  array  [ 1 . . 10 , 1 . . 99]  of  integer; 
aryS  =  array  [1..3]  of  integer; 
ary6  =  array  [1..2,1..2]  of  integer; 
ary?  =  array  [1..2,1..2]  of  real; 
aryS  =  array  [1..2,1..1]  of  real; 

var 

orimodelno  ;  aryl; 

select_basex ,  select_basey ,  test_basex ,  test_basey ,  rest_basex , 
rest_basey  :  ary 2 ; 

hashkey, inkey, modelno,tripletno  :  integer; 
recogmodelno, recoginteresting, vot  ;  integer; 
collected_keyl , collected_key2  ;  real; 
test_recogx , test_recogy , ordered_test_inter_coordx , 
ordered_test_inter_coordy , 

ordered_test_basex, ordered_test_basey  :  ary3 ; 

X, y , oriinterestno  ;  ary4 ; 
oritx,ority  :  aryS; 
base_matrix  :  ary6 ; 

inverse_matrix  :  ary? ; 
diff, coord  :  aryS ; 
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deletemodelno  :  array  [0. .totalmodelno]  of  integer; 
interesting, vote, plot ing  :  text; 
korder,jr  :  integer; 
i  :  integer; 


procedure  inatrix_mult  (inverse_niatrix  :  ary7; 

var  diff, coord  ;  aryS) ; 


{this  is  for  the  matrix  multiplication  of  inverse  of 
x(l-2)  xf2-3)  restx(i) -x(3) 

y(l-2)  y(2-3)  and  resty (i) -y (3) } 


const  k  =  2 ; 
l  =  2; 


m  =  1 ; 

var  i,il,n  :  integer; 
begin 

for  i  :=  1  to  1  do 
for  il  :=  1  to  m  do 
coord [ i , i 1 ]  0 ; 

for  i  :=  1  to  1  do 
for  il  :=  1  to  m  do 
for  n  :=  1  to  1  do 
coord[i,il]  :=  coord[i,il] 
diff [n, il] ; 


end; 


+  inverse_matrix [ i , n] 


* 


I 


procedure  inverse (base_matrix  :  ary6; 

var  inverse_matrix  :  ary'!’) 


{find  the  inverse  matrix 


of  x(l-2) 
y(l-2) 


x(2-3) 

y(2-3; 


var  det 


real 


begin 

det  :=  (base_matrix [ 
(base_matrix[ 1 , 
inverse_matrix [1,1] 
inverse_matrix [1,2] 
inverse_matr ix [2,1] 
inverse_matr ix [2,2] 
end; 


*  base_matrix [ 2 , 2  ] )  - 
base_matrix [ 2,1])  ; 

=  base_matrix[ ? , 2 ] /det ; 

=  base_matrix[ 1 , 2 ]  *  {-1) 
=  base_matrix[2 , 1]  *  (-1) 
=  base_matrix[ 1 , 1]  /det; 


1,1] 
2]  * 


/det  ; 
/det  ; 


procedure  calculate_coord (recogmodelno  :  integer; 

cbasex , cbasey  :  ary5) ; 

{calculate  the  /xi  and  /eta  of  the 
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(select_basex, select_basey)  in  of  the  model} 

var  i,m,il,i2,i3  :  integer; 
begin 

for  i  :=  1  to  2  do 
begin 

base_matrix[l, i]  :=  cbasex[i]  -  cbasex[i+l]; 

base_matrix[2 , i]  :=  cbasey[i]  -  cbasey[i+l]; 
end; 

inverse (base_matrix, inverse_matrix) ; 
i2  :=  1; 

for  i  :=  1  to  oriinterestno[orimodelno[recogmodelno] , 
recogmodelno]  do 

begin 

if  ((cbasex[l]  <>  x [ recogmode 1 no, i] ) 
or  (cbasey[l]  <>  y [recogmodelno, i] ) )  and 
((cbasex[2]  <>  x [ recogmodelno, i] ) 
or  (cbasey[2]  <>  y [recogmodelno, i ]) )  and 
((cbasex[3]  <>  x [ recogmodelno, i] ) 
or  (cbasey[3]  <>  y [recogmodelno, i ]) )  then 
begin 

rest_basex[ i]  :=  x [ recogmodelno, i] ; 
rest_basey [ i]  :=  y [ recogmode 1 no, i] ; 

diff[l,l]  :=  rest_basex[ i ]  -  cbasex[3]; 
diff[2,l]  :=  rest_basey [i]  -  cbasey[3]; 
matr ix_mul t ( inverse_matr ix , di f  f , coord ) ; 
ordered_test_inter_coordx [ i ] : =coord [1,1]* 
(ordered_test_basex[ 1 ] -ordered_test_basex [ 2 ] ) + 
coord [ 2 , 1 ] * ( ordered_test_basex [ 2 ] - 
ordered_test_basex [ 3 ] ) + 
ordered_test_basex[3] ; 

ordered_test_inter_coordy [ i ] : =coord [1,1]* 

( ordered_test_basey [ 1 ] -ordered_test_basey [ 2 ] ) + 
coord [ 2 , 1 ] * ( ordered_test_basey [ 2 ] - 
ordered_test_basey [ 3 ] ) + 
ordered_test_basey [ 3 ] ; 
end  ; 

end; 

for  i  :=  1  to  oriinterestno[orimodelno[ recogmodelno] , 

recogmodelno]  do 

writeln (ploting , ordered_test_inter_coordx [ i ] , 
ordered_test_inter_coordy [ i ] ) ; 

end; 


procedure  col inear (var  comx, corny  :  ary 5; 
var  tl,t2  ;  real) ; 

{using  tangent  y/x  to  test  if  3  points  are  colinear? 

tl  and  t2  are  the  tangent  value  of  any  2  pairs  of  coordinates} 

var  colinearxl , colinearx2 , colinearyl , colineary2  :  integer; 
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begin 


colinearxl  :=  comx[2]  -  coinx[l]; 

colinearx2  :=  comx[3]  -  comx[2]; 

colinearyl  :=  comy[2]  -  coiny[l]; 

colineary 2  :=  coiny[3]  -  corny [2]; 

if  (colinearxl  <>  0)  then 
tl  :=  arctan (colinearyl  /  colinearxl) 
else  tl  :=  1.5707; 
if  (colinearx2  <>  0)  then 
t2  :=  arctan (colineary2  /  colinearx2) 
else  t2  :=  1.5707; 

end; 


procedure  pretest (i,j  :  integer; 

var  tl,t2  :  real) ; 


(prepareing  for  colinear  testing) 

var  count  :  integer; 
begin 

count  : =  1 ; 

while  ( (test_recogx[ j ] <>0)  or  (test_recogy [ j ] <>0) )  and 
(  count  <  4  )  do 
begin 

or itx [ count ] : =x [ i , j ] ; 
or ity [ count ] : =y [ i , j ] ; 

ordered_test_inter_coordx[ j J  ;=  test_recogx[ j ] ; 
ordered_test_inter_coordy [ j ]  : =  test_recogy [ j ] ; 
ordered_test_basex[ count]  :=  test_recogx[ j ] ; 
ordered_test_basey [count]  :=  test_recogy [ j ] ; 

j  :=  j+i; 

count  ;=  count+1; 
end; 

colinear (oritx,ority,tl,t2) ; 
end; 


procedure  mapping (bx, by  :  real; 

var  ordering  ;  integer; 
i  :  integer) ; 

(make  the  first  record  data  from  the  vote  corresponding  to 
that  in  the  second  record  bx,by  is  the  input  (select_basex 
select_basey)  or  the  calculated  rest  interesting  point  in 
the  model  orcJering  is  to  pass  back  to  match  the  interesting 
point  between  model  and  recognized  model ) 

var 

j  :  integer; 

begin 

for  j  ;=  1  to  oriinterestno[orimodelno[ i] , i]  do 
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begin 

if  (abs(bx  -  x[i,j])  <  0.00001)  and 

(abs(by  -  y[i,j])  <  0.00001)  then 
begin 

ordering  : =  j ; 

end; 

end; 

end; 


procedure  interest; 

{read  into  the  original  model  interesting  number  and  their 
coordinates) 

var 

i,j,k,kl  :  integer; 

begin 

open (interesting, ' interesting. dat history  :=  old) ; 
reset (interesting) ; 

open(ploting, 'ploting.dat history  :=  new); 

rewrite (plot ing) ; 

i;=l; 

while  not  eof (interesting)  do 
begin 

read ( interesting , or imodelno [ i ] ) ; 
readln( interesting, oriinterestno[ or imodelno[ i] , i] ) ; 
for  j  :=  1  to  oriinterestno[orimodelno[i] , i]  do 
readln(interesting,x[orimodelno[i] , j ] , 
y [ orimodelno [ i ] , j ] ) ; 

i  :=  i+l; 
korder  : =i ; 
end; 

for  k:=  1  to  orimodelno [korder-1]  do 
for  kl  :=  1  to  oriinterestno [ orimodelno [ k] , k]  do 
end; 


procedure  recognized; 

(read  the  recognized  model  i.e.,  vote  data  find  the  order  in 
the  recognized  model) 

var 

i , il, i2 , j , j 1, k  ;  integer; 

select_model_tempx, select_roodel_tempy , tl , t2  : real ; 

begin 

open  (vote, 'vote.dat ', history  ;=  old); 
reset (vote) ; 
i  :  =1  ; 

while  (not  eof (vote))  do 
begin 
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readln (vote , hashkey , inkey , modelno , tr ipletno , collected_key 1 , 
collected_key2 , 

select_basex [ 1 ] , select_basey [ 1 ] , selectbasex [ 2 ] , 
select_basey  [ 2  ]  ,select_basex[3] ,  select_basey  [  3  ]  ,vot) 

readln (vote , inkey , collected_keyl , collected_key2 , 
test_basex [ 1 ] , test_basey [ 1 ] , test_basex [2] , 
test_basey [ 2 ] , test_basex [ 3 ] , test_basey [ 3 ] ) ; 
recogmodelno  :=  modelno; 

if  (recogmodelno  <>  deleteroodelno[recogmodelno] )  and 
(vot/ (oriinterestno[orimodelno[recogmodelno] , 
recogmodelno]-!)  >=  0.5y 
then 

{The  vote  number  must  be  less  than  original  model  interesting 
number  -  3  and  greater  than  1  or  a  relative  ratio  ,i.e.  vote 
number  vs.  original  interesting  number  -  3,  must  greater  or 
equal  to  threshold  0.5) 

{  ( ( (oriinterestno[orimodelno[recogmodelno] , 

recogmodelno] -3 )  >=  vot)  and 
(vot  >  1))  then) 

begin 

for  J:=l  to  3  do 
begin 

mapping (select_basex[ j ] , select_basey [ j ] , jr, 
recogmodelno) ; 

test_recogx[ jr]  :=  test_basex[ j ] ; 
test_recogy [ jr]  :=  test_basey [ j ] ; 
end ; 

select_model_tempx  :=  collected_keyl* (select_basex[ 1] 

select_basex[2  ] )  +  collec  i.„_key2*  (select_basex[  2  ] 

select_basex [ 3 ] ) +select_.  .sex [ 3 ] ; 
select_model_tempy  :=  collected_keyl* (select_basey [ 1] 

select_basey [2 ] ) +  collected_key2* (select_basey [2 ] 

select_basey [ 3 ] ) +select_basey [ 3 ] ; 
mapping ( select_model_tempx, select_model_tempy , j  r , 
recogmodelno) ; 

test_recogx[ jr]  :=  collected_keyl* (test_basex[ 1] - 
test_basex [ 2 ] ) + 

col lected_key2  * ( test_basex [ 2 ] -test_basex [ 3 ] ) 
+test_basex [ 3 ] ; 

test_recogy [ jr]  :=  collected_keyl* (test_basey [ 1] - 
test_basey [ 2 ] ) + 

collected_key2* ( test_basey [ 2 ] -test_basey [ 3 ] ) 
+test_basey [ 3 ] ; 
for  jl  :=  1  to  vot-1  do 
begin 
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readln (vote , hashkey, inkey , modelno , tripletno , 
coilected_keyl , collected_key2 , 
select_basex [ 1 ] , select_basey [ 1 ] , select_basex [ 2 ] , 
select_basey [ 2 ] , select_basex [ 3 ] , select_basey [ 3 ] ) ; 
readln (vote , inkey , collected_key 1 , collected_key 2 , 
test_basex [ 1 ] , test_basey [ 1 ] , test_basex [ 2 ] , 
test_basey [2] , test_basex [ 3 ] , test_basey [ 3 ] ) ; 
select_inodel_teinpx  :=  collected_keyl*  (select_basex[l] 

select_basex[2] )+  collected_key2* (select_basex [ 2 ] 

select_basex [ 3 ] ) +select_basex [ 3 ] ; 
select_model_teinpy  :=  collected_keyl*  (select_basey  [1] 

select_basey [ 2 ] ) +  collected_key2  * ( select_basey [ 2 ] 

select_basey [ 3 ] ) +select_basey [ 3 ] ; 

mapping  (select_inodel_teinpx,  select_model_tempy ,  jr, 
recogmodelno) ; 

test_recogx[ jr]  :=  collected_keyl* (test_basex [ 1 ] - 
test_basex [ 2 ] ) +collected_key2  * 

( test_basex [ 2 ] -test_basex [ 3 ] ) +test_basex [ 3 ] ; 
test_recogy [ jr]  ;=  collected_keyl* (test_basey [ l] - 
test_basey[2] ) +collected_key2* 

( test_basey [ 2 ] -test_basey [ 3 ] ) +test_basey [ 3 ] ; 

end; 

recoginteresting  ;=  vot+3 ; 
writeln (ploting , recogmodelno , or iinterestno [ 

orimodelno[ recogmodelno] , recogmodelno] ) ; 
il:=l;tl:=l;t2:=l; 
pretest (recogmodelno, il, tl, t2) ; 

if  tl<>t2  then  calcuiate_coord( recogmodelno, 

oritx, ority) 

else  pretest (recogmodelno, il+l,tl,t2) ; 
deletemodelno[ recogmodelno] :=  recogmodelno; 
end 
end; 
end; 

begin (main) 
interest; 
recognized; 
end. 
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